00010000:00010000:1.0F:1787360282.043971:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0F:1787360282.873757:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787360282.873769:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360282.873795:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787360282.873802:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0F:1787360283.065407:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1787360283.389256:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596153088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360283.389323:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360283.389391:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153088 00000100:00100000:2.0:1787360283.389398:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153088 00000100:00100000:2.0:1787360283.389446:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787360283.389454:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596153088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360283.389482:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360283.389522:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596153088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360283.389529:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787360283.389549:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360283.389587:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890539d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596153088:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1787360283.904533:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1787360283.904551:0:17185:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998903478180 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1787360283.904556:0:17185:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07d2d100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998903478300 00000020:00080000:3.0:1787360283.904560:0:17185:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07d2d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9989035f7e00 00000020:00080000:0.0:1787360283.904728:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1787360283.904793:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787360283.906350:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906366:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906374:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906381:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360283.906387:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906395:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906414:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:1.0:1787360283.906418:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360283.906422:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360283.906430:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360284.089451:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360284.410133:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596153216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360284.410208:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.410292:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153216 00000100:00100000:2.0:1787360284.410299:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153216 00000100:00100000:2.0:1787360284.410342:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787360284.410351:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596153216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360284.410382:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787360284.410426:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596153216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.410433:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787360284.410476:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596153216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360284.411222:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596153344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360284.411282:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.411323:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153344 00000100:00100000:2.0:1787360284.411338:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153344 00000100:00100000:2.0:1787360284.411369:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360284.411376:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596153344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360284.411396:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787360284.411433:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596153344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.411440:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360284.411471:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596153344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360284.921550:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596153472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360284.921611:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.921670:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153472 00000100:00100000:2.0:1787360284.921676:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153472 00000100:00100000:2.0:1787360284.921720:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360284.921730:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596153472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360284.921757:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360284.921797:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596153472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.921804:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787360284.921821:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360284.921854:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596153472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360284.922199:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596153728:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922383:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922414:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596154240:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922436:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922452:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596154752:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922484:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922503:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787360284.922508:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596153856:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922545:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922567:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596154368:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922589:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922609:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596154880:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922627:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.922769:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153728 00000100:00100000:2.0:1787360284.922775:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153728 00000100:00100000:2.0:1787360284.922810:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154240 00000100:00100000:2.0:1787360284.922813:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154240 00000100:00100000:2.0:1787360284.922830:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787360284.922837:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922882:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596153728:12345-0@lo:400:kworker.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.922889:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787360284.922902:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787360284.922909:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.922949:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596154240:12345-0@lo:400:kworker.0 Request processed in 41us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.922955:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787360284.922979:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154752 00000100:00100000:2.0:1787360284.922983:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154752 00000100:00100000:2.0:1787360284.923014:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154880 00000100:00100000:2.0:1787360284.923017:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154880 00000100:00100000:2.0:1787360284.923038:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360284.923052:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923084:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596154752:12345-0@lo:400:kworker.0 Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.923090:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360284.923103:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360284.923110:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923139:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596154880:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.923145:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360284.923165:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153856 00000100:00100000:2.0:1787360284.923168:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153856 00000100:00100000:2.0:1787360284.923375:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154368 00000100:00100000:2.0:1787360284.923380:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154368 00000100:00100000:2.0:1787360284.923406:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360284.923414:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596153856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923561:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596153856:12345-0@lo:400:kworker.0 Request processed in 37us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.923570:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360284.923585:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787360284.923592:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923626:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596154368:12345-0@lo:400:kworker.0 Request processed in 35us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.923632:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787360284.923679:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596153600:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923711:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.923741:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596154112:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.923979:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.924044:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596154624:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.924068:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.924609:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596155136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360284.924636:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.924660:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787360284.924667:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596153984:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.924690:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.924706:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596154496:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.924725:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360284.924763:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153984 00000100:00100000:0.0:1787360284.924770:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153984 00000100:00100000:0.0:1787360284.924810:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787360284.924817:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596153984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360284.924967:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596153984:12345-0@lo:400:kworker.0 Request processed in 150us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360284.924974:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787360284.925030:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154112 00000100:00100000:1.0:1787360284.925035:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154112 00000100:00100000:1.0:1787360284.925061:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154624 00000100:00100000:1.0:1787360284.925064:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154624 00000100:00100000:1.0:1787360284.925086:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787360284.925092:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596154112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360284.925125:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596154112:12345-0@lo:400:kworker.0 Request processed in 33us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360284.925139:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787360284.925152:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787360284.925158:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596154624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360284.925186:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596154624:12345-0@lo:400:kworker.0 Request processed in 28us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360284.925191:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787360284.925725:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596155008:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.925758:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.925861:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596154112:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.925875:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596154624:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.925898:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596153984:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926057:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596153600 00000100:00100000:2.0:1787360284.926063:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596153600 00000100:00100000:2.0:1787360284.926103:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787360284.926112:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3661:x1874182596153600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926153:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3661:x1874182596153600:12345-0@lo:400:kworker.0 Request processed in 43us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.926160:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787360284.926188:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360284.926199:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596155264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360284.926317:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360284.926350:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155136 00000100:00100000:2.0:1787360284.926355:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155136 00000100:00100000:2.0:1787360284.926376:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155264 00000100:00100000:2.0:1787360284.926379:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155264 00000100:00100000:2.0:1787360284.926395:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360284.926403:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596155136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360284.926426:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360284.926463:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596155136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.926469:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360284.926481:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360284.926486:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596155264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360284.926495:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360284.926527:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596155264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.926533:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787360284.926548:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360284.926553:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360284.926556:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360284.926557:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360284.926586:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596155264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360284.926630:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596153856:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926644:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596154368:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926656:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596154880:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926667:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596153728:0@lo:400:kworker.0 00000100:00100000:2.0:1787360284.926688:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596154240:0@lo:400:kworker.0 00010000:00080000:2.0:1787360284.926703:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059f80 x1874182596154752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360284.926713:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596154752:0@lo:400:kworker.0 00000100:00100000:0.0:1787360284.926759:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596154496 00000100:00100000:1.0:1787360284.926760:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155008 00000100:00100000:2.0:1787360284.926764:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596153600:0@lo:400:kworker.0 00000100:00100000:1.0:1787360284.926766:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155008 00000100:00100000:0.0:1787360284.926766:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596154496 00000100:00100000:2.0:1787360284.926785:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596155136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360284.926808:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787360284.926814:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360284.926817:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596154496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360284.926826:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596155008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360284.926871:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596155008:12345-0@lo:400:kworker.0 Request processed in 50us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360284.926880:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787360284.926906:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360284.927010:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596154496:12345-0@lo:400:kworker.0 Request processed in 194us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360284.927018:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787360284.927042:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596154496:0@lo:400:kworker.0 00010000:00080000:2.0:1787360284.927051:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35055500 x1874182596155008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360284.927059:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596155008:0@lo:400:kworker.0 00010000:00010000:0.0:1787360285.119690:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360285.168764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360285.182119:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107584 00000100:00100000:2.0:1787360285.182132:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107584 00000100:00100000:2.0:1787360285.182208:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360285.182217:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:15587:x1874182575107584:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787360285.182331:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:15587:x1874182575107584:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 115us (13575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.182339:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00080000:3.0:1787360285.182372:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360285.185125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.185199:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107712 00000100:00100000:1.0:1787360285.185208:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107712 00000100:00100000:1.0:1787360285.185289:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:1.0:1787360285.185300:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15587:x1874182575107712:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787360285.185385:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15587:x1874182575107712:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360285.185392:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00080000:3.0:1787360285.185756:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360285.200668:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360285.200742:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107968 00000100:00100000:3.0:1787360285.200751:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107968 00000100:00100000:3.0:1787360285.200804:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1787360285.200815:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:15587:x1874182575107968:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360285.201206:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+14:15587:x1874182575107968:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 392us (546us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787360285.201215:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:1.0:1787360285.552507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.552549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.552580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360285.552811:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108096 00000100:00100000:3.0:1787360285.552821:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108096 00000100:00100000:3.0:1787360285.552891:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:3.0:1787360285.552902:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:2402:x1874182575108096:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360285.552974:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:2402:x1874182575108096:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 74us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360285.552981:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:1.0:1787360285.553190:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.553259:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.553283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000040:00080000:1.0:1787360285.563371:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787360285.564077:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360285.564234:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108352 00000100:00100000:2.0:1787360285.564244:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108352 00000100:00100000:2.0:1787360285.564304:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108224 00000100:00100000:2.0:1787360285.564308:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108224 00000100:00100000:2.0:1787360285.564320:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108736 00000100:00100000:2.0:1787360285.564323:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108736 00000100:00100000:2.0:1787360285.564350:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1787360285.564360:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575108352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360285.564428:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575108352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 70us (11879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.564436:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1787360285.564452:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:2.0:1787360285.564458:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+14:2402:x1874182575108224:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360285.564488:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+14:2402:x1874182575108224:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (11907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.564508:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:2.0:1787360285.564521:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:2.0:1787360285.564528:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2402:x1874182575108736:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360285.564552:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2402:x1874182575108736:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (11268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.564558:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:2.0:1787360285.564589:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108480 00000100:00100000:2.0:1787360285.567694:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108480 00000100:00100000:2.0:1787360285.567768:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108608 00000100:00100000:2.0:1787360285.567775:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108608 00000100:00100000:2.0:1787360285.567864:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1787360285.567875:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575108480:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360285.567945:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575108480:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 63us (14745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.567965:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1787360285.567981:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:2.0:1787360285.567987:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2398:x1874182575108608:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:2.0:1787360285.568004:0:18714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215cd 00000100:00080000:2.0:1787360285.568015:0:18714:0:(import.c:65:import_set_state_nolock()) ffff9989037da000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787360285.568127:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787360285.568246:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+2:2398:x1874182575108608:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 258us (14987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.568253:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00080000:2.0:1787360285.568282:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360285.568285:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360285.568287:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787360285.568299:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360285.570894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360285.570930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360285.571201:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108992 00000100:00100000:3.0:1787360285.571209:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108992 00000100:00100000:3.0:1787360285.571292:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109120 00000100:00100000:3.0:1787360285.571295:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109120 00000100:00100000:3.0:1787360285.571314:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1787360285.571324:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2398:x1874182575108992:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:3.0:1787360285.571349:0:18711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721605 00000100:00080000:3.0:1787360285.571362:0:18711:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360285.571399:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787360285.571552:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+2:2398:x1874182575108992:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 229us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360285.571560:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1787360285.571575:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:3.0:1787360285.571592:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2398:x1874182575109120:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:3.0:1787360285.571976:0:18711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72160c 00000100:00080000:3.0:1787360285.571983:0:18711:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360285.572007:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787360285.572081:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+2:2398:x1874182575109120:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 490us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360285.572088:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00010000:00010000:0.0:1787360285.572261:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360285.572339:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360285.572349:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360285.572353:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360285.572364:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575108864 00000100:00100000:2.0:1787360285.572368:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575108864 00000100:00100000:2.0:1787360285.572409:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:2.0:1787360285.572416:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575108864:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360285.572447:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575108864:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (8375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360285.572453:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00080000:3.0:1787360285.574347:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787360286.137991:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360287.161333:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360288.185534:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360288.505471:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360288.505501:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596155392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360288.505587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360288.507085:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155392 00000100:00100000:2.0:1787360288.507096:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155392 00000100:00100000:2.0:1787360288.507167:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787360288.507186:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596155392:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787360288.507338:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787360288.507408:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360288.507485:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596155392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 300us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360288.507492:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360288.507593:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596155392:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787360289.210218:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360289.530399:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360289.530421:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596155520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360289.530480:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360289.530539:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155520 00000100:00100000:2.0:1787360289.530545:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155520 00000100:00100000:2.0:1787360289.530587:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787360289.530596:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596155520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360289.530625:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787360289.530667:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596155520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360289.530674:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787360289.530715:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596155520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360289.530885:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360289.530895:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596155648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360289.530934:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360289.530971:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155648 00000100:00100000:1.0:1787360289.530975:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155648 00000100:00100000:1.0:1787360289.531000:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787360289.531006:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596155648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360289.531024:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787360289.531057:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596155648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360289.531063:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787360289.531092:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596155648:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1787360289.537566:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787360289.537578:0:17185:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1787360289.537671:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1787360289.537681:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:02000400:2.0:1787360289.590966:0:20582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 20:58:08 (1787360288) 00000100:00100000:1.0:1787360290.041526:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596156032:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041594:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041637:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596156544:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041660:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041678:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596157056:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041700:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041721:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787360290.041727:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596156160:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041757:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041790:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596156672:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041809:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041824:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596157184:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.041847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360290.041877:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156032 00000100:00100000:1.0:1787360290.041883:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156032 00000100:00100000:1.0:1787360290.041963:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156544 00000100:00100000:1.0:1787360290.041966:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156544 00000100:00100000:1.0:1787360290.041980:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156160 00000100:00100000:1.0:1787360290.041982:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156160 00000100:00100000:1.0:1787360290.041993:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156672 00000100:00100000:1.0:1787360290.041995:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156672 00000100:00100000:1.0:1787360290.042008:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787360290.042017:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596156032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042061:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596156032:12345-0@lo:400:kworker.0 Request processed in 45us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042068:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787360290.042095:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787360290.042102:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596156544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042127:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596156544:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042133:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787360290.042143:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360290.042149:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596156160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042173:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596156160:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042187:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360290.042198:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360290.042203:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042264:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596156672:12345-0@lo:400:kworker.0 Request processed in 60us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042270:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360290.042302:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157056 00000100:00100000:1.0:1787360290.042305:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157056 00000100:00100000:1.0:1787360290.042328:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157184 00000100:00100000:1.0:1787360290.042330:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157184 00000100:00100000:1.0:1787360290.042346:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787360290.042353:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596157056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042380:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596157056:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042386:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787360290.042396:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787360290.042401:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042424:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596157184:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.042429:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787360290.042450:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360290.042454:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360290.042457:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360290.042459:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360290.042492:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596156160:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042502:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596156672:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042518:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596157184:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042526:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596156032:0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.042534:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596156544:0@lo:400:kworker.0 00010000:00080000:1.0:1787360290.042543:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904815f80 x1874182596157056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360290.042553:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596157056:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043328:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596155904:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043368:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043410:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596156416:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043433:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043448:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596156928:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043469:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043486:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787360290.043492:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596155776:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043589:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043689:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596156288:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043716:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043731:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596156800:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043751:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043764:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596157312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.043871:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.043898:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155776 00000100:00100000:0.0:1787360290.044020:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155776 00000100:00100000:0.0:1787360290.044063:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787360290.044071:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3659:x1874182596155776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.044192:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596155904 00000100:00100000:1.0:1787360290.044197:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596155904 00000100:00100000:1.0:1787360290.044238:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156416 00000100:00100000:1.0:1787360290.044242:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156416 00000100:00100000:1.0:1787360290.044257:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360290.044263:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596155904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.044313:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596155904:12345-0@lo:400:kworker.0 Request processed in 50us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.044320:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360290.044336:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787360290.044342:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596156416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360290.044369:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596156416:12345-0@lo:400:kworker.0 Request processed in 28us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.044376:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787360290.044399:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156928 00000100:00100000:1.0:1787360290.044403:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156928 00000100:00100000:1.0:1787360290.044428:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156288 00000100:00100000:1.0:1787360290.044431:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156288 00000100:00100000:1.0:1787360290.044440:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596156800 00000100:00100000:1.0:1787360290.044450:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596156800 00000100:00100000:1.0:1787360290.044463:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157312 00000100:00100000:1.0:1787360290.044466:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157312 00000100:00100000:1.0:1787360290.044481:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787360290.044487:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596156928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360290.044760:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787360290.044791:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596156288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.044899:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3659:x1874182596155776:12345-0@lo:400:kworker.0 Request processed in 828us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360290.044924:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787360290.045122:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360290.045134:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596157568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360290.045164:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360290.045195:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157568 00000100:00100000:2.0:1787360290.045199:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157568 00000100:00100000:2.0:1787360290.045263:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787360290.045271:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596157568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360290.045294:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360290.045332:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596157568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360290.045338:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787360290.045378:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596157568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360290.046301:0:17241:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787360290.046311:0:17241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787360290.046327:0:17206:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787360290.046337:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787360290.046346:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596156800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.046391:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596156800:12345-0@lo:400:kworker.0 Request processed in 47us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360290.046398:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787360290.046413:0:17206:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787360290.046419:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360290.046426:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596157312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.046456:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596157312:12345-0@lo:400:kworker.0 Request processed in 31us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360290.046474:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360290.046497:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596157440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360290.046543:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360290.046578:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596155776:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.046591:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596156800:0@lo:400:kworker.0 00010000:00080000:0.0:1787360290.046603:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904815880 x1874182596157312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360290.046612:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596157312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.046635:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596155904:0@lo:400:kworker.0 00000100:00100000:0.0:1787360290.046646:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596156416:0@lo:400:kworker.0 00000100:00100000:2.0:1787360290.047351:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157440 00000100:00100000:2.0:1787360290.047358:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157440 00000100:00100000:2.0:1787360290.047392:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360290.047398:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596157440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360290.047413:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360290.047458:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596157440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360290.047464:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360290.047483:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596157696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360290.047518:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360290.047543:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157696 00000100:00100000:2.0:1787360290.047546:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157696 00000100:00100000:2.0:1787360290.047560:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787360290.047566:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596157696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360290.047581:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360290.047612:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596157696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360290.047958:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596156288:12345-0@lo:400:kworker.0 Request processed in 3188us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360290.047966:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787360290.048123:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596156928:12345-0@lo:400:kworker.0 Request processed in 3634us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.048131:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1787360290.048218:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360290.048223:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360290.048360:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787360290.048396:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596157696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360290.048438:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596157440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360290.048449:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596156288:0@lo:400:kworker.0 00000100:00100000:2.0:1787360290.048460:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596156928:0@lo:400:kworker.0 00010000:00010000:1.0:1787360290.235346:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360290.664061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360290.664121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360290.664203:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109248 00000100:00100000:3.0:1787360290.664214:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109248 00000100:00100000:3.0:1787360290.664287:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:3.0:1787360290.664297:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:2402:x1874182575109248:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360290.664363:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:2402:x1874182575109248:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360290.664372:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:2.0:1787360290.669699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360290.672725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360290.675641:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109504 00000100:00100000:1.0:1787360290.675654:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109504 00000100:00100000:2.0:1787360290.678245:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360290.678278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360290.678311:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109632 00000100:00100000:2.0:1787360290.678320:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109632 00000100:00100000:2.0:1787360290.678378:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1787360290.678389:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575109632:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360290.678456:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575109632:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360290.678464:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1787360290.678859:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109760 00000100:00100000:1.0:1787360290.678864:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109760 00000100:00100000:1.0:1787360290.678902:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109376 00000100:00100000:1.0:1787360290.678917:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109376 00000100:00100000:1.0:1787360290.678934:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575109888 00000100:00100000:1.0:1787360290.678937:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575109888 00000100:00100000:1.0:1787360290.678950:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:1.0:1787360290.678957:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2402:x1874182575109760:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360290.678987:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2402:x1874182575109760:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.678994:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:1.0:1787360290.679007:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:1.0:1787360290.679012:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:2402:x1874182575109376:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360290.679036:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:2402:x1874182575109376:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (6317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.679053:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:1.0:1787360290.679067:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:1.0:1787360290.679087:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2402:x1874182575109888:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360290.679115:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2402:x1874182575109888:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360290.679121:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00080000:1.0:1787360290.679140:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360290.679144:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360290.679146:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360290.684499:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360290.684632:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 93 00000100:00100000:3.0:1787360290.684647:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575109504:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360290.684794:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2402:x1874182575109504:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 82us (20602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360290.684803:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 93 00010000:00010000:2.0:1787360291.269649:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787360291.589041:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000020:00000080:3.0:1787360291.589054:0:19526:0:(genops.c:885:class_export_put()) final put ffff998a2ed9b000/924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:3.0:1787360291.589079:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000020:00000080:3.0:1787360291.589082:0:19526:0:(genops.c:885:class_export_put()) final put ffff9989037da800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000020:00000080:1.0:1787360291.589156:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9b000/924bac3c-3aca-4cde-8ca8-f46336646f6e for lustre-OST0001 00000020:00000080:1.0:1787360291.589220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989037da800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d for lustre-OST0001 00000020:00000080:1.0:1787360291.589269:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed9d000 for lustre-OST0001 00000020:00000080:1.0:1787360291.589275:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989037da000 for lustre-OST0001 00000001:00100000:3.0:1787360291.594282:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000020:00000080:3.0:1787360291.594292:0:18708:0:(genops.c:885:class_export_put()) final put ffff998a2ed98800/924bac3c-3aca-4cde-8ca8-f46336646f6e 00000020:00000080:1.0:1787360291.594348:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed98800/924bac3c-3aca-4cde-8ca8-f46336646f6e for lustre-OST0000 00000020:00000080:1.0:1787360291.594421:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed9f800 for lustre-OST0000 00000040:00080000:0.0:1787360292.090408:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787360292.090418:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360292.090442:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787360292.090452:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787360292.281533:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360293.307153:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360293.627414:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596157824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360293.627508:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360293.627633:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157824 00000100:00100000:2.0:1787360293.627660:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157824 00000100:00100000:2.0:1787360293.627725:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787360293.627736:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596157824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360293.627765:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360293.627810:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596157824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360293.627827:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787360293.627947:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360293.627982:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596157824:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787360294.329444:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360294.578604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360294.578697:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575110144 00000100:00100000:3.0:1787360294.578707:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575110144 00000100:00100000:3.0:1787360294.578778:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:3.0:1787360294.578794:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+13:16348:x1874182575110144:12345-192.168.206.11@tcp:35:umount.0 00000001:00080000:3.0:1787360294.579026:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1787360294.579114:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1787360294.579294:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:16348:x1874182575110144:12345-192.168.206.11@tcp:35:umount.0 Request processed in 506us (697us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1787360294.579302:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000020:00080000:3.0:1787360294.579306:0:17208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1787360294.580355:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360294.586847:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360294.586912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360294.586950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360294.587317:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575110272 00000100:00100000:0.0:1787360294.587332:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575110272 00000100:00100000:0.0:1787360294.587410:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575110528 00000100:00100000:0.0:1787360294.587414:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575110528 00000100:00100000:0.0:1787360294.587429:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575110400 00000100:00100000:0.0:1787360294.587432:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575110400 00000100:00100000:0.0:1787360294.587452:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360294.587462:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+15:2402:x1874182575110272:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360294.587476:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360294.587494:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caef800/0x359a4e2aee7215a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3d5 expref: 15 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.587526:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360294.587582:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+14:2402:x1874182575110272:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 121us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360294.587590:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360294.587608:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787360294.587614:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+13:2402:x1874182575110528:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360294.587622:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360294.587631:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516000/0x359a4e2aee721667 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4bc expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.587641:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360294.587660:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+12:2402:x1874182575110528:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 46us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360294.587666:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787360294.587678:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1787360294.587685:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a227f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+11:2402:x1874182575110400:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360294.587693:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360294.587701:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caef600/0x359a4e2aee7215aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef406 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.587715:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360294.587734:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a227f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+10:2402:x1874182575110400:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 49us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360294.587740:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1787360294.594476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360294.594589:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575110656 00000100:00100000:1.0:1787360294.594599:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575110656 00000100:00100000:1.0:1787360294.594680:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:1.0:1787360294.594690:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2398:x1874182575110656:12345-192.168.206.11@tcp:9:umount.0 00000020:00000080:1.0:1787360294.594726:0:18714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215c6 00000100:00080000:1.0:1787360294.594736:0:18714:0:(import.c:65:import_set_state_nolock()) ffff9989037d9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360294.594784:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787360294.594940:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+2:2398:x1874182575110656:12345-192.168.206.11@tcp:9:umount.0 Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360294.594955:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00010000:00010000:0.0:1787360294.595125:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787360294.595278:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360294.603305:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360294.603518:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575111552 00000100:00100000:1.0:1787360294.603527:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575111552 00000100:00100000:1.0:1787360294.603586:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360294.603597:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:2398:x1874182575111552:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:1.0:1787360294.603627:0:17241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215b8 00000020:00010000:1.0:1787360294.603648:0:17241:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998a05835800: total 0 00000100:00080000:1.0:1787360294.603652:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998a05830000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360294.603683:0:17241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1787360294.603833:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+15:2398:x1874182575111552:12345-192.168.206.11@tcp:39:umount.0 Request processed in 237us (535us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1787360294.603841:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000020:00010000:0.0:1787360294.603948:0:17193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998a05835800: total 0 00010000:00010000:0.0:1787360294.603953:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360294.604009:0:17193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998a05835800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787360294.604042:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360294.604045:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360294.604053:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef52c expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604071:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:0.0:1787360294.604073:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360294.604078:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4d8 expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604091:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a28ed0400) 00010000:00010000:0.0:1787360294.604093:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360294.604097:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041600/0x359a4e2aee72169f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ca expref: 12 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604114:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:0.0:1787360294.604117:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360294.604120:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680800/0x359a4e2aee72186d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef556 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604133:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998a28ed0a00) 00010000:00010000:0.0:1787360294.604136:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360294.604139:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4c3 expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604176:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:0.0:1787360294.604178:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787360294.604182:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef502 expref: 9 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604197:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360294.604199:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360294.604203:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604214:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360294.604217:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360294.604220:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee7218c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef572 expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360294.604272:0:17193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998a05835800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787360294.604287:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360294.604289:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360294.604291:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360294.618909:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360294.618988:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575111680 00000100:00100000:3.0:1787360294.618998:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575111680 00000100:00100000:3.0:1787360294.619066:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:3.0:1787360294.619080:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2398:x1874182575111680:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:3.0:1787360294.619108:0:17205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215bf 00000100:00080000:3.0:1787360294.619124:0:17205:0:(import.c:65:import_set_state_nolock()) ffff998a05834800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360294.619157:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787360294.619376:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+3:2398:x1874182575111680:12345-192.168.206.11@tcp:39:umount.0 Request processed in 301us (473us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787360294.619384:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00080000:1.0:1787360294.619516:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787360294.619558:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360294.649562:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360294.649585:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596157952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360294.649657:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360294.649985:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596157952 00000100:00100000:1.0:1787360294.649994:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596157952 00000100:00100000:1.0:1787360294.650047:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787360294.650056:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596157952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360294.650088:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787360294.650159:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596157952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360294.650166:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787360294.650280:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596157952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360294.650857:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596158080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360294.650909:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360294.651002:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158080 00000100:00100000:3.0:1787360294.651008:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158080 00000100:00100000:3.0:1787360294.651053:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787360294.651062:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596158080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360294.651084:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360294.651147:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596158080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360294.651155:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787360294.651419:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596158080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360295.164837:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596158336:0@lo:400:kworker.0 00000100:00100000:0.0:1787360295.164881:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596158592:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.165483:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596158208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.165582:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596158464:0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.174988:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175096:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596158848:0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.175173:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175209:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596159360:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.175266:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175287:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175340:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596159872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360295.175373:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360295.175377:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158208 00000100:00100000:3.0:1787360295.175387:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158208 00000100:00100000:3.0:1787360295.175454:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787360295.175465:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159360 00000100:00100000:3.0:1787360295.175468:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3661:x1874182596158208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.175475:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159360 00000100:00100000:3.0:1787360295.175545:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3661:x1874182596158208:12345-0@lo:400:kworker.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.175553:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787360295.175563:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787360295.175571:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596159360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.175623:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175649:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596159360:12345-0@lo:400:kworker.0 Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.175660:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787360295.175691:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.175699:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158464 00000100:00100000:1.0:1787360295.175706:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158464 00000100:00100000:1.0:1787360295.175752:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360295.175765:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175773:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596158464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.175799:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.175834:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596158464:12345-0@lo:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.175854:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360295.175858:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.175871:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158976 00000100:00100000:1.0:1787360295.175877:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158976 00000100:00100000:3.0:1787360295.175917:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159488 00000100:00100000:3.0:1787360295.175925:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159488 00000100:00100000:1.0:1787360295.175929:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787360295.175943:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596158976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.175998:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360295.176005:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596158976:12345-0@lo:400:kworker.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.176032:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.176039:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787360295.176075:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158336 00000100:00100000:1.0:1787360295.176082:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158336 00000100:00100000:3.0:1787360295.176095:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596159488:12345-0@lo:400:kworker.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.176105:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360295.176118:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158848 00000100:00100000:1.0:1787360295.176124:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158848 00000100:00100000:1.0:1787360295.176151:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787360295.176161:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596158336:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787360295.176164:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eddd180 x1874182596159488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360295.176181:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596159488:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.176193:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360295.176255:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596158336:12345-0@lo:400:kworker.0 Request processed in 67us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.176265:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787360295.176275:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.176288:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360295.176299:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596158848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.176335:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596158464:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.176357:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.176359:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596158848:12345-0@lo:400:kworker.0 Request processed in 60us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.176371:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360295.176407:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159872 00000100:00100000:1.0:1787360295.176412:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159872 00000100:00100000:1.0:1787360295.176437:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160000 00000100:00100000:1.0:1787360295.176440:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160000 00000100:00100000:1.0:1787360295.176452:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787360295.176458:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596159872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787360295.176485:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787360295.176521:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596159872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.176527:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787360295.176539:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787360295.176545:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596160000:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787360295.176619:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360295.176625:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360295.176627:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360295.176630:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360295.176686:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596159872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360295.176701:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596158336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.176712:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596158848:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.176723:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596159360:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.177817:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596158208:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.177830:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596158720:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.177896:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360295.177920:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596159232:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.177941:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360295.177962:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596159744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.177981:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360295.178006:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:1.0:1787360295.178700:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787360295.178794:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596160000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2246us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.178805:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787360295.178905:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596160000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360295.178966:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158720 00000100:00100000:1.0:1787360295.178975:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158720 00000100:00100000:1.0:1787360295.179019:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159232 00000100:00100000:1.0:1787360295.179022:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159232 00000100:00100000:1.0:1787360295.179042:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159744 00000100:00100000:1.0:1787360295.179045:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159744 00000100:00100000:1.0:1787360295.179074:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360295.179083:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596158720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.179126:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596158720:12345-0@lo:400:kworker.0 Request processed in 45us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.179133:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360295.179145:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787360295.179151:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596159232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.179178:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596159232:12345-0@lo:400:kworker.0 Request processed in 28us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.179184:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787360295.179195:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787360295.179202:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596159744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360295.184789:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596159744:12345-0@lo:400:kworker.0 Request processed in 5570us (6790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360295.184810:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360295.186193:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360295.186270:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596159104:0@lo:400:kworker.0 00000100:00100000:0.0:1787360295.186322:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360295.186356:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596159616:0@lo:400:kworker.0 00000100:00080000:1.0:1787360295.186715:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787360295.186773:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596158592 00000100:00100000:1.0:1787360295.186785:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596158592 00000100:00100000:0.0:1787360295.187221:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360295.187349:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159104 00000100:00100000:1.0:1787360295.187357:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159104 00000100:00100000:2.0:1787360295.187475:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596160128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360295.187509:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360295.187552:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596158720:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.187564:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596159232:0@lo:400:kworker.0 00010000:00080000:2.0:1787360295.187578:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a6300 x1874182596159744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360295.187588:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596159744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.187618:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596159616 00000100:00100000:2.0:1787360295.187633:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596159616 00000100:00100000:3.0:1787360295.187736:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360295.187753:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.187804:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596158592:12345-0@lo:400:kworker.0 Request processed in 59us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.188717:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360295.188747:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360295.188761:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.188816:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596159104:12345-0@lo:400:kworker.0 Request processed in 61us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.188827:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787360295.189386:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596158592:0@lo:400:kworker.0 00000100:00100000:3.0:1787360295.189390:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160128 00000100:00100000:3.0:1787360295.189396:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160128 00000100:00100000:0.0:1787360295.189400:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596159104:0@lo:400:kworker.0 00000100:00080000:0.0:1787360295.189441:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360295.189446:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787360295.189448:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360295.189463:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596160128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360295.189481:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360295.189527:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596160128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.189534:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787360295.189581:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596160128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360295.192311:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787360295.192332:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596159616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360295.192420:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596159616:12345-0@lo:400:kworker.0 Request processed in 98us (5204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360295.192430:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787360295.192520:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596159616:0@lo:400:kworker.0 00010000:00010000:0.0:1787360295.356099:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360295.789338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360295.789398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360295.789433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360295.789475:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112064 00000100:00100000:2.0:1787360295.789488:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112064 00000100:00100000:2.0:1787360295.789575:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575111936 00000100:00100000:2.0:1787360295.789579:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575111936 00000100:00100000:2.0:1787360295.789608:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:2.0:1787360295.789620:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575112064:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360295.789713:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575112064:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 95us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360295.789722:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:2.0:1787360295.789742:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:2.0:1787360295.789750:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575111936:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360295.789780:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575111936:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360295.789787:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:3.0:1787360295.789951:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575111808 00000100:00100000:3.0:1787360295.789956:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575111808 00000100:00100000:3.0:1787360295.790012:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:3.0:1787360295.790022:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:2401:x1874182575111808:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360295.790056:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:2401:x1874182575111808:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 37us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360295.790063:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00080000:0.0:1787360295.791734:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360295.791745:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1787360295.802855:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787360296.377920:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360296.504585:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360296.504631:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360296.504669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360296.504797:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112192 00000100:00100000:3.0:1787360296.504816:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112192 00000100:00100000:1.0:1787360296.504841:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112448 00000100:00100000:1.0:1787360296.504853:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112448 00000100:00100000:3.0:1787360296.504931:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112320 00000100:00100000:3.0:1787360296.504937:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112320 00000100:00100000:1.0:1787360296.506525:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360296.506548:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14e95e5c-9854-457b-a93b-73582689ff25+12:2400:x1874182575112192:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360296.506568:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360296.506591:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516600/0x359a4e2aee7215e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef445 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360296.506610:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360296.506673:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14e95e5c-9854-457b-a93b-73582689ff25+11:2400:x1874182575112192:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 135us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360296.507166:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360296.507209:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14e95e5c-9854-457b-a93b-73582689ff25+11:2400:x1874182575112448:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360296.507258:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360296.507280:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688000/0x359a4e2aee721660 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4b5 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360296.507298:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360296.507554:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360296.507593:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1787360296.507605:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14e95e5c-9854-457b-a93b-73582689ff25+9:2400:x1874182575112320:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360296.507617:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360296.507633:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517400/0x359a4e2aee7215e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef476 expref: 9 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360296.507647:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360296.507751:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14e95e5c-9854-457b-a93b-73582689ff25+8:2400:x1874182575112448:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 552us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360296.507758:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14e95e5c-9854-457b-a93b-73582689ff25+8:2400:x1874182575112320:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 151us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360296.507779:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360296.507790:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1787360296.509564:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360296.510387:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112704 00000100:00100000:0.0:1787360296.510404:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112704 00000100:00100000:0.0:1787360296.510484:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:0.0:1787360296.510497:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2398:x1874182575112704:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:0.0:1787360296.510547:0:20605:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215f7 00000020:00010000:0.0:1787360296.510558:0:20605:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998a3c2b8800: total 0 00000100:00080000:0.0:1787360296.510564:0:20605:0:(import.c:65:import_set_state_nolock()) ffff998a3c2b9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787360296.510604:0:20605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1787360296.510803:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2398:x1874182575112704:12345-192.168.206.11@tcp:39:umount.0 Request processed in 307us (1244us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787360296.510811:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000020:00010000:1.0:1787360296.511909:0:17193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998a3c2b8800: total 0 00010000:00010000:1.0:1787360296.512016:0:17193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998a3c2b8800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787360296.512061:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:1.0:1787360296.512065:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360296.512076:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4df expref: 4 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360296.512102:0:17193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998a3c2b8800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787360296.512114:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360296.512116:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360296.512118:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360296.523780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360296.523928:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575112832 00000100:00100000:0.0:1787360296.523941:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575112832 00000100:00100000:0.0:1787360296.524016:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1787360296.524028:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2398:x1874182575112832:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:0.0:1787360296.524092:0:17241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7215fe 00000100:00080000:0.0:1787360296.524104:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998a3c2bf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787360296.524142:0:17241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1787360296.524372:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+3:2398:x1874182575112832:12345-192.168.206.11@tcp:39:umount.0 Request processed in 345us (614us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787360296.524382:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00010000:00010000:2.0:1787360296.525372:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360296.575070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360296.575209:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113088 00000100:00100000:0.0:1787360296.575223:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113088 00000100:00100000:0.0:1787360296.575334:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00100000:0.0:1787360296.575347:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+7:2398:x1874182575113088:12345-192.168.206.11@tcp:251:umount.0 00000020:00000080:0.0:1787360296.575401:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721595 00000020:00010000:0.0:1787360296.575410:0:17199:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998a043a2800: total 0 00000100:00080000:0.0:1787360296.575417:0:17199:0:(import.c:65:import_set_state_nolock()) ffff998a043a2000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787360296.575502:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+3:2398:x1874182575113088:12345-192.168.206.11@tcp:251:umount.0 Request processed in 157us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360296.575511:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 175 00000020:00010000:1.0:1787360296.576130:0:17193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998a043a2800: total 0 00010000:00010000:1.0:1787360296.576137:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360296.576195:0:17193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998a043a2800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787360296.576265:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caeee00/0x359a4e2aee72159c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ce expref: 2 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360296.576285:0:17193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998a043a2800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787360296.576297:0:17193:0:(genops.c:885:class_export_put()) final put ffff998a043a2800/14e95e5c-9854-457b-a93b-73582689ff25 00010000:00010000:1.0:1787360296.576318:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360296.576321:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360296.576323:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787360296.576370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a2800/14e95e5c-9854-457b-a93b-73582689ff25 for MGS 00000020:00000080:2.0:1787360296.576415:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a043a2000 for MGS 00010000:00010000:0.0:1787360297.411627:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360298.426060:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787360298.544041:0:20778:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360298.558209:0:20778:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787360298.558285:0:20778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.558299:0:20778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.558306:0:20778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.558345:0:20778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.558369:0:20778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360298.558375:0:20778:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787360298.558403:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360298.558407:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360298.558412:0:20778:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360298.558435:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998a3c824000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787360298.558570:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360298.558578:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558586:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeec00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360298.558589:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558610:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360298.558618:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360298.558624:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360298.558626:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787360298.558628:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787360298.558654:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558661:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360298.558689:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558696:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558709:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360298.558710:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360298.558712:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360298.558720:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360298.558736:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596160384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360298.558796:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360298.558872:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160384 00000100:00100000:1.0:1787360298.558879:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160384 00000100:00100000:1.0:1787360298.558921:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360298.558929:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596160384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360298.558958:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360298.558972:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697200/0x359a4e2aee72115f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721158 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.558984:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360298.559015:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:3660:x1874182596160384:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360298.559022:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360298.559057:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596160384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360298.562194:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596160256:0@lo:39:umount.0 00000100:00100000:3.0:1787360298.562521:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360298.569000:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160256 00000100:00100000:0.0:1787360298.569014:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160256 00000100:00100000:0.0:1787360298.569129:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787360298.569241:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874182596160256:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787360298.570024:0:17206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721189 00000100:00080000:0.0:1787360298.570035:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9989029fb000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787360298.570431:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1874182596160256:12345-0@lo:39:umount.0 Request processed in 1290us (7908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360298.570441:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1787360298.570454:0:17206:0:(genops.c:885:class_export_put()) final put ffff998a0ffae000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787360298.570471:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787360298.570488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a0ffae000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787360298.570538:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989029fb000 for lustre-MDT0000 00000100:00080000:1.0:1787360298.573156:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c824000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787360298.573185:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596160256:0@lo:39:umount.0 00000100:00080000:0.0:1787360298.575785:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360298.575793:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360298.575799:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787360298.576756:0:20778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576790:0:20778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576798:0:20778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576805:0:20778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576829:0:20778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360298.576835:0:20778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576842:0:20778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576848:0:20778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576855:0:20778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576879:0:20778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787360298.576886:0:20778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576893:0:20778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576909:0:20778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576915:0:20778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576922:0:20778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787360298.576927:0:20778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.576930:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787360298.576933:0:20778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576939:0:20778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576945:0:20778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360298.576952:0:20778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787360298.576954:0:20778:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787360298.576980:0:20778:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787360298.576984:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787360298.576988:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360298.576993:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787360298.576999:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998902a1f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787360298.577002:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360298.577005:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a043a7000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787360298.577010:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696800 already unused, calling callback (ffffffffc14bfc20) 00000020:00080000:0.0:1787360298.577010:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a05896000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360298.577019:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a042ae000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360298.577026:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998a3c2b8800 924bac3c-3aca-4cde-8ca8-f46336646f6e 192.168.206.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787360298.577031:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998a05835800 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 192.168.206.11@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787360298.577036:0:20778:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99890273b370) has exports, disconnecting them 00000020:00080000:0.0:1787360298.577040:0:20778:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998902a1f000), last request at 1787360295 00000020:00000080:0.0:1787360298.577046:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213c0 00000100:00080000:0.0:1787360298.577063:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998902a19000 : changing import state from FULL to CLOSED 10000000:00010000:3.0:1787360298.577077:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577086:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360298.577093:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360298.577103:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998902a1f000): rc 0 00000020:00000080:0.0:1787360298.577105:0:20778:0:(genops.c:885:class_export_put()) final put ffff998902a1f000/lustre-MDT0000-lwp-OST0001_UUID 10000000:01000000:3.0:1787360298.577110:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360298.577112:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787360298.577114:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1787360298.577127:0:20778:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a043a7000), last request at 1787360295 00000020:00000080:0.0:1787360298.577130:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721326 00000100:00080000:0.0:1787360298.577135:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998a043a5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360298.577140:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a043a7000): rc 0 00000020:00000080:0.0:1787360298.577142:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a043a7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787360298.577146:0:20778:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a05896000), last request at 1787360223 00000020:00000080:0.0:1787360298.577148:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721277 00000100:00080000:0.0:1787360298.577151:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998a05897000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360298.577156:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a05896000): rc 0 00010000:00010000:3.0:1787360298.577157:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787360298.577158:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a05896000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787360298.577161:0:20778:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a042ae000), last request at 1787360222 00010000:00010000:3.0:1787360298.577164:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1787360298.577164:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72121c 00000100:00080000:0.0:1787360298.577168:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998902a5f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787360298.577172:0:20778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:3.0:1787360298.577185:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577192:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577203:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787360298.577206:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577212:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360298.577214:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577221:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360298.577247:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360298.577247:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a042ae000): rc 0 10000000:01000000:3.0:1787360298.577252:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000004:00000080:0.0:1787360298.577253:0:20778:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4f781577ae0 10000000:01000000:3.0:1787360298.577254:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787360298.577262:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1787360298.577268:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360298.577275:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787360298.577276:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577281:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360298.577287:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577294:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577303:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360298.577306:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577311:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360298.577326:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577333:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360298.577340:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360298.577346:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787360298.577348:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787360298.577349:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787360298.577360:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577365:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360298.577393:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577400:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577409:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360298.577412:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577417:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360298.577420:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577427:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360298.577433:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360298.577438:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360298.577445:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787360298.577447:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787360298.577458:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577464:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360298.577469:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577475:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.577503:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360298.577504:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360298.577506:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360298.577520:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596160512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360298.577587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.577634:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360298.577639:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596160640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360298.577658:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.577680:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596160896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360298.577704:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.577718:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360298.577723:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596160768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360298.577741:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.577767:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160512 00000100:00100000:3.0:1787360298.577774:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160512 00000100:00100000:3.0:1787360298.577813:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160640 00000100:00100000:3.0:1787360298.577816:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160640 00000100:00100000:3.0:1787360298.577835:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160896 00000100:00100000:3.0:1787360298.577838:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160896 00000100:00100000:1.0:1787360298.577889:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596160768 00000100:00100000:1.0:1787360298.577893:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596160768 00000100:00100000:1.0:1787360298.577918:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360298.577928:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+26:3658:x1874182596160512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360298.577940:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360298.577956:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697000/0x359a4e2aee7210b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee7210a9 expref: 26 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.577968:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360298.578007:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+25:3658:x1874182596160512:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360298.578014:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360298.578030:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360298.578036:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3658:x1874182596160640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360298.578046:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360298.578062:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681c00/0x359a4e2aee72158e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721587 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.578071:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360298.578093:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:3658:x1874182596160640:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360298.578099:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360298.578111:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360298.578117:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:3661:x1874182596160768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360298.578124:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360298.578133:0:20233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688600/0x359a4e2aee721659 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721652 expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360298.578141:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360298.578167:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3661:x1874182596160768:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360298.578175:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360298.578208:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596160768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360298.578259:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360298.578345:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596160640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360298.578353:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596160512:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787360298.579590:0:20778:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787360298.579616:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787360298.579666:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161024:0@lo:39:umount.0 00000100:00100000:1.0:1787360298.579826:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360298.579939:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161024 00000020:00000080:2.0:1787360298.579946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a1f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1787360298.579946:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161024 00000100:00100000:0.0:1787360298.579988:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787360298.579996:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596161024:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787360298.580002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787360298.580018:0:17211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7212a1 00000020:00000080:2.0:1787360298.580023:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05896000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1787360298.580025:0:17211:0:(import.c:65:import_set_state_nolock()) ffff998a059e6800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787360298.580044:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a19000 for lustre-MDT0000 00000001:00000004:0.0:1787360298.580044:0:17211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000020:00000080:2.0:1787360298.580048:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a043a5000 for lustre-MDT0000 00000020:00000080:2.0:1787360298.580051:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05897000 for lustre-MDT0000 00010000:00010000:2.0:1787360298.580168:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360298.580376:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787360298.580380:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1787360298.580394:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787360298.580460:0:20778:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787360298.580473:0:20778:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787360298.580485:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787360298.580487:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1787360298.580496:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360298.580533:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360298.580542:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:3661:x1874182596160896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360298.580552:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787360298.580563:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161152:0@lo:9:umount.0 00010000:00010000:3.0:1787360298.580566:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697c00/0x359a4e2aee7210a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72109b expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360298.580579:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360298.580595:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.580614:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3661:x1874182596160896:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360298.580622:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787360298.580626:0:20778:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787360298.580635:0:20778:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787360298.580649:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161280:0@lo:9:umount.0 00000100:00100000:3.0:1787360298.580663:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161152 00000100:00100000:3.0:1787360298.580668:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161152 00000100:00100000:1.0:1787360298.580671:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360298.580697:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161280 00000100:00100000:3.0:1787360298.580700:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161280 00000100:00100000:3.0:1787360298.580720:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360298.580728:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596161152:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787360298.580742:0:18714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213e3 00000100:00080000:3.0:1787360298.580748:0:18714:0:(import.c:65:import_set_state_nolock()) ffff998a05833800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360298.580781:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787360298.580835:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3657:x1874182596161024:12345-0@lo:39:umount.0 Request processed in 839us (1008us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787360298.580842:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787360298.580882:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3657:x1874182596161152:12345-0@lo:9:umount.0 Request processed in 155us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360298.580889:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360298.580901:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787360298.580905:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787360298.580908:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596161280:12345-0@lo:9:umount.0 00000004:00080000:1.0:1787360298.580909:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787360298.580911:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360298.580913:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161152:0@lo:9:umount.0 00000020:00000080:3.0:1787360298.580919:0:18714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213ea 00000100:00080000:3.0:1787360298.580925:0:18714:0:(import.c:65:import_set_state_nolock()) ffff998a05832800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787360298.580925:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787360298.580930:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161024:0@lo:39:umount.0 00000001:00000004:3.0:1787360298.580965:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000020:00080000:1.0:1787360298.580984:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99890273b370) has no exports 00010000:00010000:0.0:1787360298.581025:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360298.581050:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3657:x1874182596161280:12345-0@lo:9:umount.0 Request processed in 142us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360298.581056:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360298.581082:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596160896:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787360298.581102:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360298.581105:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360298.581116:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360298.581132:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787360298.581141:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787360298.581142:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360298.581145:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596161280:0@lo:9:umount.0 00000020:00080000:1.0:1787360298.590149:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99890273b370) has no exports 00000020:00000080:1.0:1787360298.650045:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210f6 00000020:00000080:1.0:1787360298.650061:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a09392000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787360298.650128:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787360298.650195:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a09392000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787360298.650479:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360298.650488:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360298.650493:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9989034d4d28) has no exports 00000020:00000080:0.0:1787360298.651016:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210ef 00000020:00000080:0.0:1787360298.651023:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a09394800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787360298.651082:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360298.651089:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787360298.651092:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a03950800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787360298.651094:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff998a03950800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787360298.651100:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787360298.651386:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a09394800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787360298.745485:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360298.745529:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596161408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360298.745598:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360298.745772:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161408 00000100:00100000:0.0:1787360298.745786:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161408 00000100:00100000:0.0:1787360298.745850:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787360298.745862:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596161408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360298.745920:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787360298.745967:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596161408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360298.745975:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787360298.746648:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360298.746691:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596161408:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787360299.450737:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360299.771425:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360299.771448:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596161536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360299.771516:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360299.771653:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161536 00000100:00100000:1.0:1787360299.771676:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161536 00000100:00100000:1.0:1787360299.771721:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787360299.771729:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1874182596161536:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787360299.771737:0:17210:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787360299.771777:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1874182596161536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (261us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360299.771784:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:02020000:1.0:1787360299.771985:0:3658:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787360299.781432:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787360299.781441:0:3658:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787360299.781446:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787360299.790836:0:3658:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360299.790850:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1787360299.790875:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff998a3784b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360299.790914:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff45180 x1874182596161664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360299.791179:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596161664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787360299.791292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360299.791415:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161664 00000100:00100000:0.0:1787360299.791423:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161664 00000100:00100000:0.0:1787360299.791458:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787360299.791466:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596161664:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787360299.791483:0:17211:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787360299.806577:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596161664:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 15101us (15276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787360299.806591:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787360299.806721:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360299.806727:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787360299.806730:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596161664:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787360300.281625:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596161920:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.281632:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596162176:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.281704:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596161792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360300.281721:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596162048:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.281789:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360300.281826:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596162688:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.281851:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360300.281898:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162688 00000100:00100000:2.0:1787360300.281905:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162688 00000100:00100000:2.0:1787360300.281941:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360300.281948:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1874182596162688:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787360300.281955:0:17207:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787360300.281991:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1874182596162688:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787360300.281998:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787360300.282028:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787360300.282033:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787360300.282036:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787360300.282056:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360300.282067:0:3659:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1787360300.282073:0:3659:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9989035fd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360300.282102:0:3659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdc000 x1874182596162944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360300.282121:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596162688:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.282159:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162176 00000100:00100000:2.0:1787360300.282163:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162176 00000100:00100000:2.0:1787360300.282199:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787360300.282206:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.282266:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596162176:12345-0@lo:400:kworker.0 Request processed in 61us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360300.282273:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787360300.282288:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360300.282309:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596162176:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.282344:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596162944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787360300.282367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360300.282398:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162944 00000100:00100000:2.0:1787360300.282402:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162944 00000100:00100000:2.0:1787360300.282421:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360300.282425:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596162944:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787360300.282437:0:17241:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787360300.282465:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596162944:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 39us (97us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360300.282471:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787360300.282493:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360300.282497:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360300.282507:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596162944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787360300.296385:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360300.296442:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596162432:0@lo:400:kworker.0 00000100:00100000:3.0:1787360300.296491:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360300.296543:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162432 00000100:00100000:3.0:1787360300.296550:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162432 00000100:00100000:3.0:1787360300.296584:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787360300.296590:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1874182596162432:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787360300.296597:0:20605:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787360300.296630:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1874182596162432:12345-0@lo:400:kworker.0 Request processed in 39us (138us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787360300.296636:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787360300.296666:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787360300.296670:0:3661:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787360300.296674:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787360300.296679:0:3661:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360300.296694:0:3661:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787360300.296699:0:3661:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998a2f243800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360300.296727:0:3661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edbaa00 x1874182596163072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360300.296749:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596162432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.300195:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161920 00000100:00100000:2.0:1787360300.300211:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161920 00000100:00100000:2.0:1787360300.300317:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787360300.300339:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3661:x1874182596161920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360300.300431:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3661:x1874182596161920:12345-0@lo:400:kworker.0 Request processed in 95us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360300.300439:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787360300.300504:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596163072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787360300.300540:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360300.300579:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163072 00000100:00100000:2.0:1787360300.300583:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163072 00000100:00100000:2.0:1787360300.300606:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360300.300611:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596163072:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787360300.300626:0:17205:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787360300.301832:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596161920:0@lo:400:kworker.0 00000100:00100000:1.0:1787360300.302667:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360300.302669:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360300.302715:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.302715:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596162304:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.302754:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360300.302775:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596162816:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.302794:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360300.302827:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360300.302886:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162048 00000100:00100000:3.0:1787360300.302893:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162048 00000100:00100000:3.0:1787360300.302949:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787360300.302967:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596162048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360300.303012:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596162048:12345-0@lo:400:kworker.0 Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360300.303019:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787360300.303401:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360300.303827:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162304 00000100:00100000:0.0:1787360300.303834:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162304 00000100:00100000:1.0:1787360300.303848:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162816 00000100:00100000:1.0:1787360300.303863:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162816 00000100:00100000:0.0:1787360300.303881:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596162560 00000100:00100000:0.0:1787360300.303886:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596162560 00000100:00100000:1.0:1787360300.303923:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787360300.303934:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360300.303987:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596162816:12345-0@lo:400:kworker.0 Request processed in 56us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360300.304638:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360300.304655:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.304700:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596162560:12345-0@lo:400:kworker.0 Request processed in 53us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360300.304715:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360300.304734:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787360300.304740:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1874182596162304:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787360300.304747:0:20605:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787360300.304781:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1874182596162304:12345-0@lo:400:kworker.0 Request processed in 40us (2027us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787360300.304788:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787360300.304852:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787360300.304869:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787360300.304873:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787360300.304878:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360300.304882:0:3660:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:0.0:1787360300.304888:0:3660:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998a05894000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360300.304918:0:3660:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904174700 x1874182596163200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360300.304941:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596162304:0@lo:400:kworker.0 00010000:00080000:0.0:1787360300.304962:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904fdf100 x1874182596162816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360300.304973:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596162816:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.305005:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596163200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787360300.305055:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360300.305096:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163200 00000100:00100000:0.0:1787360300.305101:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163200 00000100:00100000:0.0:1787360300.305129:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787360300.305133:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596163200:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787360300.305147:0:20605:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787360300.305178:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596163200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 43us (138us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360300.305191:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787360300.305292:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360300.305297:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360300.305300:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596163200:0@lo:38:ptlrpcd_00_02.0 00010000:00080000:0.0:1787360300.305405:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904fdd500 x1874182596162560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360300.305416:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787360300.305443:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596162048:0@lo:400:kworker.0 00000100:00080000:0.0:1787360300.305584:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360300.305606:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596161792 00000100:00100000:0.0:1787360300.305611:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596161792 00000100:00100000:0.0:1787360300.305642:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787360300.305648:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596161792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360300.305669:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360300.305709:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596161792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360300.305716:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787360300.305748:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596161792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360300.311103:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787360300.322428:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596163072:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 21806us (21878us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360300.322451:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787360300.324096:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360300.324106:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360300.324110:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596163072:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787360300.482440:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787360300.799089:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787360300.799114:0:17939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787360300.799135:0:17939:0:(genops.c:885:class_export_put()) final put ffff998a059e1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787360300.799158:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00080000:0.0:1787360300.799164:0:17939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787360300.799166:0:17939:0:(genops.c:885:class_export_put()) final put ffff998a3c2be000/924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:0.0:1787360300.799172:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00080000:0.0:1787360300.799178:0:17939:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787360300.799180:0:17939:0:(genops.c:885:class_export_put()) final put ffff998a05837800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00100000:1.0:1787360300.799307:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360300.799316:0:18708:0:(genops.c:885:class_export_put()) final put ffff998a05835000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787360300.799328:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000020:00000080:1.0:1787360300.799330:0:18708:0:(genops.c:885:class_export_put()) final put ffff9989037d8800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000020:00000080:2.0:1787360300.799778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a059e1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787360300.799841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c2be000/924bac3c-3aca-4cde-8ca8-f46336646f6e for lustre-MDT0001 00000020:00000080:2.0:1787360300.799876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05837800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d for lustre-MDT0001 00000020:00000080:2.0:1787360300.799912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05835000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787360300.799928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989037d8800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d for lustre-OST0000 00000020:00000080:2.0:1787360300.799942:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a059e6800 for lustre-MDT0001 00000020:00000080:2.0:1787360300.799946:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c2bf000 for lustre-MDT0001 00000020:00000080:2.0:1787360300.799949:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05834800 for lustre-MDT0001 00000020:00000080:2.0:1787360300.799965:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05833800 for lustre-OST0000 00000020:00000080:2.0:1787360300.799968:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989037d9800 for lustre-OST0000 00000001:00100000:3.0:1787360300.808562:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360300.808572:0:17185:0:(genops.c:885:class_export_put()) final put ffff998a042ae000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787360300.808595:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00080000:3.0:1787360300.808604:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1787360300.808608:0:17185:0:(genops.c:885:class_export_put()) final put ffff998a3c2b8800/924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:3.0:1787360300.808614:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00080000:3.0:1787360300.808619:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787360300.808643:0:17185:0:(genops.c:885:class_export_put()) final put ffff998a05835800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000020:00000080:0.0:1787360300.808906:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042ae000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787360300.808968:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c2b8800/924bac3c-3aca-4cde-8ca8-f46336646f6e for lustre-MDT0000 00000020:00000080:0.0:1787360300.809020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05835800/6a6c5b69-4b93-4276-a9fb-fa611f6ac03d for lustre-MDT0000 00000020:00000080:0.0:1787360300.809062:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a5f800 for lustre-MDT0000 00000020:00000080:0.0:1787360300.809069:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c2b9000 for lustre-MDT0000 00000020:00000080:0.0:1787360300.809074:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05830000 for lustre-MDT0000 00010000:00010000:0.0:1787360301.497653:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360302.521645:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360303.546886:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360303.865710:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596163328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360303.865785:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360303.866088:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163328 00000100:00100000:1.0:1787360303.866096:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163328 00000100:00100000:1.0:1787360303.866172:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787360303.866183:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596163328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360303.866211:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787360303.866282:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596163328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360303.866289:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360303.866428:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596163328:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787360303.866496:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360304.569453:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787360304.698718:0:20778:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989034fade0 - data ffff998a29c5dbd0/ffff998a05875800 00000020:01000000:0.0:1787360304.698907:0:20778:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998903be54e0 - data ffff99890203f360/ffff998a35aa3000 00000001:00000004:0.0:1787360304.708403:0:20778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1787360304.781141:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787360304.781153:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787360304.781172:0:20778:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff998a3510ce00 x1874182596161024/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787360308 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360304.781207:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787360304.785059:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787360304.785070:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1787360304.785092:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360304.785095:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787360304.786956:0:17229:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787360304.786966:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1787360304.786982:0:17229:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787360304.787812:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787360304.787818:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787360304.787847:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360304.787851:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787360304.788173:0:17231:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787360304.788178:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1787360304.788190:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787360304.790930:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210be 00000020:00000080:3.0:1787360304.790946:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787360304.791743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787360304.793374:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210d3 00000020:00000080:3.0:1787360304.793390:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787360304.793407:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787360304.793576:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360304.793587:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787360304.793592:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff998902738000) has no exports 00000004:01000000:3.0:1787360304.793794:0:20778:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787360304.793804:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721135 00000020:00000080:3.0:1787360304.793810:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3c9c7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787360304.793842:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787360304.793846:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360304.793852:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360304.793855:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff998a350599b8) has no exports 00000020:00000080:3.0:1787360304.793863:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72112e 00000020:00000080:3.0:1787360304.793868:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3c9c0000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787360304.794402:0:20778:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787360304.794484:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787360304.794490:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1787360304.794498:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360304.794501:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360304.794541:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360304.794549:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787360304.794558:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721120 00000020:00000080:3.0:1787360304.794565:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a07d78000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787360304.794571:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787360304.794576:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360304.794579:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360304.794582:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff998a359499b8) has no exports 00000020:00000080:3.0:1787360304.794586:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721119 00000020:00000080:3.0:1787360304.794589:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e3000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787360304.794973:0:20778:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787360304.794977:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787360304.794981:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1787360304.794984:0:20778:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360304.794986:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360304.795024:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360304.795029:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787360304.795042:0:20778:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787360304.795048:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72110b 00000020:00000080:3.0:1787360304.795053:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a07d79000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787360304.795057:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787360304.795070:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360304.795074:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360304.795077:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff998a3c904d28) has no exports 00000020:00000080:3.0:1787360304.795081:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721104 00000020:00000080:3.0:1787360304.795085:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a03956000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787360304.795427:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787360304.795440:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c9c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787360304.795445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c9c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787360304.795451:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c9c5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787360304.795458:0:8:0:(genops.c:885:class_export_put()) final put ffff998a07d7a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787360304.795468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a07d7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787360304.795473:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360304.795579:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a07d78000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787360304.795586:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787360304.795589:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989036e0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787360304.795593:0:8:0:(genops.c:885:class_export_put()) final put ffff998a07d7c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787360304.795595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a07d7c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787360304.795599:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360304.795625:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a07d79000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787360304.795630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a03956000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787360304.802367:0:20778:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787360304.802379:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787360304.802384:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360304.802395:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360304.802478:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360304.802493:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360304.802533:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360304.802537:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360304.802558:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989041aa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360304.802564:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff9989041aa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787360304.802573:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360304.802713:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210da 00000020:00000080:1.0:1787360304.802722:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e5000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787360304.802728:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787360304.802732:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360304.802738:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787360304.802743:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9989027399b8) has no exports 00000020:00000080:1.0:1787360304.802764:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360304.802768:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787360304.802773:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7210e1 00000020:00000080:1.0:1787360304.802777:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e4800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787360304.802787:0:20778:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61f800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787360304.802790:0:20778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61f800 3 00000020:01000004:1.0:1787360304.802794:0:20778:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a3d61f800 from lustre-MDT0000 00000020:00000080:1.0:1787360304.802814:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360304.802817:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787360304.802819:0:20778:0:(genops.c:885:class_export_put()) final put ffff9989036e4000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787360304.802822:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787360304.802829:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787360304.802872:0:20778:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787360304.802877:0:20778:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787360304.802880:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787360304.802888:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360304.802891:0:20778:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787360304.802899:0:20778:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9989041a8000 9b5a46b1-7024-40db-b9fb-69c8c09a9227 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787360304.802904:0:20778:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9989034d19b8) has exports, disconnecting them 00000020:00080000:1.0:1787360304.802909:0:20778:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9989041a8000), last request at 1787360209 00000020:00000080:1.0:1787360304.802929:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721086 00000020:00010000:1.0:1787360304.802934:0:20778:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9989041a8000: total 2 00000020:00000080:0.0:1787360304.802987:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a19704000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787360304.802996:0:8:0:(genops.c:885:class_export_put()) final put ffff998902616800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787360304.802998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998902616800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787360304.803003:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360304.803076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787360304.803080:0:8:0:(genops.c:885:class_export_put()) final put ffff9989036e1000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787360304.803082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787360304.803086:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787360304.803112:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1787360304.803173:0:20778:0:(import.c:65:import_set_state_nolock()) ffff9989041a8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787360304.803192:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9989041a8000): rc 0 00000020:00080000:1.0:1787360304.803197:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9989034d19b8) has no exports 00000100:00100000:1.0:1787360304.803282:0:17199:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff998904194a00:17199] 2 exiting: rc = 0 00000020:00010000:0.0:1787360304.803377:0:17193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9989041a8000: total 0 00010000:00010000:0.0:1787360304.803401:0:17193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9989041a8000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787360304.803434:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696a00/0x359a4e2aee721094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72108d expref: 14 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803452:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caef400/0x359a4e2aee721381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72137a expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803463:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517e00/0x359a4e2aee72162f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721628 expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803483:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee721580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721579 expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803496:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696200/0x359a4e2aee7211a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72119e expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803506:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a067a8200/0x359a4e2aee721311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72130a expref: 9 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803515:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70a00/0x359a4e2aee72163d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721636 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803523:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caee000/0x359a4e2aee721262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee72125b expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803533:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697400/0x359a4e2aee7211b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee7211ac expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803543:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696400/0x359a4e2aee7211c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee7211ba expref: 5 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803551:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caef000/0x359a4e2aee7213ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee7213a4 expref: 4 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803559:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71200/0x359a4e2aee72164b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee721644 expref: 3 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803569:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caee400/0x359a4e2aee7212e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee7212e0 expref: 2 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360304.803587:0:17193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9989041a8000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1787360304.803598:0:17193:0:(genops.c:885:class_export_put()) final put ffff9989041a8000/9b5a46b1-7024-40db-b9fb-69c8c09a9227 00010000:00010000:0.0:1787360304.803608:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360304.803610:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360304.803611:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787360304.803616:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989041a8000/9b5a46b1-7024-40db-b9fb-69c8c09a9227 for MGS 00000020:00000080:0.0:1787360304.803636:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989041a8800 for MGS 00000100:00100000:0.0:1787360304.803664:0:17198:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff998904194600:17198] 1 exiting: rc = 0 00000100:00100000:0.0:1787360304.818383:0:17197:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff998904194200:17197] 0 exiting: rc = 1 00000100:00100000:1.0:1787360304.819052:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819063:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819070:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819079:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819087:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819094:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819101:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819107:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819114:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819121:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819128:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819134:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819141:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819146:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819153:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819159:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819164:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819170:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819176:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819184:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819192:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819197:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819202:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819208:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819214:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819221:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819259:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819266:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819272:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819278:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819401:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819418:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819426:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819431:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819437:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819442:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819448:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819453:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819459:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819465:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819470:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819476:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819482:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819487:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819493:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819499:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819505:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819509:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819514:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819520:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819526:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819532:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819538:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819543:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819549:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819555:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819564:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819571:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819578:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819585:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819591:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819598:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819605:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360304.819613:0:20778:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787360304.821632:0:20778:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998903b94e40 - data ffff998a29c65438/ffff9989010f0800 00000020:01000000:1.0:1787360304.821800:0:20778:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99890392d240 - data ffff998a11427438/ffff998903a00400 00000020:00000080:1.0:1787360304.825955:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72106a 00000020:00000080:1.0:1787360304.825977:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3d619800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787360304.826008:0:20778:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61f800 from MGS, refs=2 00000020:01000004:1.0:1787360304.826012:0:20778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61f800 2 00000020:01000004:1.0:1787360304.826016:0:20778:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a3d61f800 from MGS 00000020:00000080:1.0:1787360304.826046:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360304.826058:0:20778:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787360304.826060:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3d61e800/MGS 00000020:00000080:1.0:1787360304.826064:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d61e800/MGS for MGS 00000020:01000000:1.0:1787360304.826075:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787360304.826178:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787360304.826182:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360304.826190:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787360304.826198:0:20778:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff998a3c821800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787360304.826204:0:20778:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff998a3c900000) has exports, disconnecting them 00000020:00080000:1.0:1787360304.826210:0:20778:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff998a3c821800), last request at 1787360209 00000020:00000080:1.0:1787360304.826215:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72116d 00000020:00080000:1.0:1787360304.826256:0:20778:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a3c821800): rc 0 00000020:00000080:1.0:1787360304.826263:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3c821800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787360304.826386:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d619800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787360304.826395:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c821800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787360304.827660:0:20778:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787360304.827668:0:20778:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360304.827673:0:20778:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787360304.827682:0:20778:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360304.827710:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c824000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787360304.827908:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360304.827916:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787360304.827922:0:20778:0:(genops.c:885:class_export_put()) final put ffff998903735800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787360304.827925:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff998903735800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787360304.827944:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787360304.828043:0:20778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61f800 1 00000020:00000080:0.0:1787360304.828050:0:20778:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72105c 00000020:00000080:0.0:1787360304.828058:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3d618800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787360304.828067:0:20778:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787360304.828075:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d618800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787360304.828085:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360304.828101:0:20778:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360304.828105:0:20778:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9989034d3370) has no exports 00000001:00100000:3.0:1787360304.929272:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787360304.929283:0:19526:0:(genops.c:885:class_export_put()) final put ffff998a05834000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787360304.929883:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05834000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787360304.929964:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05832800 for lustre-OST0001 00000040:00080000:1.0:1787360305.023183:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787360305.037342:0:20778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360305.037359:0:20778:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787360305.037366:0:20778:0:(genops.c:885:class_export_put()) final put ffff998a3d61f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787360305.037372:0:20778:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d61f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787360305.037387:0:20778:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787360305.037620:0:20778:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998a3d61e000 00000020:02000400:0.0:1787360305.037698:0:20778:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1787360305.402023:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360305.402047:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360305.402144:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360305.402296:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163456 00000100:00100000:1.0:1787360305.402307:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163456 00000100:00080000:2.0:1787360305.402366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360305.402371:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787360305.402375:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360305.402381:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 578 00000100:00100000:1.0:1787360305.402385:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787360305.402387:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787360305.402392:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff998a3784b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360305.402396:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596163456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360305.402414:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fddf80 x1874182596163712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000024:1.0:1787360305.402432:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1787360305.402441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360305.402444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787360305.402445:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360305.402448:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:2.0:1787360305.402451:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787360305.402454:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998a05894000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360305.402466:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdfb80 x1874182596163968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360305.402478:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596163456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360305.402486:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787360305.402488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360305.402491:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787360305.402492:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360305.402495:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 578 00000100:00080000:2.0:1787360305.402497:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787360305.402500:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998a2f243800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360305.402512:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdce00 x1874182596164096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360305.402576:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360305.402592:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596163712:0@lo:38:kworker.0 00000100:00100000:3.0:1787360305.402627:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360305.402652:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596163968:0@lo:38:kworker.0 00000100:00100000:0.0:1787360305.402656:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360305.402665:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596163584:0@lo:400:kworker.0 00000100:00100000:3.0:1787360305.402677:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1787360305.402692:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596163584 offset 0 length 224: 4 00000100:00100000:3.0:1787360305.402696:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596164096:0@lo:38:kworker.0 00000100:00100000:3.0:1787360305.402713:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360305.402718:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787360305.402744:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360305.402745:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163968 00000100:00100000:3.0:1787360305.402749:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163968 00000100:00100000:3.0:1787360305.402770:0:20605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164096 00000100:00100000:3.0:1787360305.402773:0:20605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164096 00000100:00100000:0.0:1787360305.402775:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787360305.402781:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596163968:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787360305.402789:0:20605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787360305.402794:0:20605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596164096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787360305.402801:0:17241:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1787360305.402802:0:20605:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787360305.402867:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596163968:12345-0@lo:38:kworker.0 Request processed in 85us (188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360305.402874:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787360305.403636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360305.403642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787360305.403645:0:37:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360305.403651:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 578 00000100:00080000:2.0:1787360305.403655:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787360305.403660:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9989035fd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360305.403682:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdf800 x1874182596164352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360305.403823:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360305.403847:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596164224:0@lo:400:kworker.0 00000100:00100000:0.0:1787360305.403891:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360305.403898:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163712 00000100:00100000:1.0:1787360305.403904:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163712 00000100:00100000:0.0:1787360305.403926:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596164480:0@lo:400:kworker.0 00000100:00100000:1.0:1787360305.403931:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787360305.403938:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596163712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787360305.403948:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1787360305.403953:0:17948:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360305.403985:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596163712:12345-0@lo:38:kworker.0 Request processed in 47us (1357us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360305.403992:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787360305.403992:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164224 00000100:00100000:0.0:1787360305.403996:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164224 00000100:00100000:0.0:1787360305.404029:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164480 00000100:00100000:0.0:1787360305.404032:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164480 00000100:00100000:0.0:1787360305.404050:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787360305.404056:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360305.404103:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596164224:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360305.404110:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787360305.404128:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787360305.404134:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596164480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360305.404167:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596164480:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360305.404173:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1787360305.404214:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904fdc380 x1874182596164480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360305.404264:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596164480:0@lo:400:kworker.0 00010000:00080000:1.0:1787360305.404271:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904fdca80 x1874182596164224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360305.404279:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596164224:0@lo:400:kworker.0 00000100:00100000:2.0:1787360305.406952:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596163840 00000100:00100000:2.0:1787360305.406972:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596163840 00000100:00100000:2.0:1787360305.407053:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360305.407066:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360305.407182:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596163840:12345-0@lo:400:kworker.0 Request processed in 118us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360305.407189:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360305.407276:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360305.409294:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596164352:0@lo:38:kworker.0 00000100:00100000:2.0:1787360305.409390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360305.409451:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360305.409456:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360305.409460:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596163712:0@lo:38:kworker.0 00000100:00080000:2.0:1787360305.409472:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360305.409475:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360305.409495:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596163968:0@lo:38:kworker.0 00000100:00100000:0.0:1787360305.409637:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164352 00000100:00100000:0.0:1787360305.409646:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164352 00000100:00100000:0.0:1787360305.409691:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360305.409702:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596164352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787360305.409729:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360305.409771:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787360305.409783:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596164352:12345-0@lo:38:kworker.0 Request processed in 82us (393us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360305.409791:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787360305.411012:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360305.411025:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360305.411030:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596164352:0@lo:38:kworker.0 00000100:00080000:2.0:1787360305.417452:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360305.417466:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360305.457794:0:20605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596164096:12345-0@lo:38:kworker.0 Request processed in 54987us (55067us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360305.457825:0:20605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787360305.457954:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360305.457961:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787360305.457967:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596164096:0@lo:38:kworker.0 00010000:00010000:1.0:1787360305.594863:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360306.618561:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360307.642218:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360308.671132:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787360308.723540:0:20980:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360308.737445:0:20980:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787360308.737522:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.737541:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.737549:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.737557:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.737578:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360308.737585:0:20980:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787360308.737630:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360308.737635:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360308.737643:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360308.737651:0:20980:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787360308.737656:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360308.737658:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360308.737662:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787360308.738636:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738653:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738677:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738684:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738708:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787360308.738716:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738723:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738730:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738737:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738745:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787360308.738751:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738758:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738763:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738780:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738788:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787360308.738793:0:20980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738799:0:20980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738805:0:20980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738820:0:20980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360308.738828:0:20980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1787360308.738832:0:20980:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787360308.738867:0:20980:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787360308.738872:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787360308.738876:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360308.738883:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787360308.738891:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9989037dd800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360308.738897:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff998a2f240000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360308.738903:0:20980:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff998a3dcb99b8) has exports, disconnecting them 00000020:00080000:0.0:1787360308.738908:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9989037dd800), last request at 1787360305 00000020:00000080:0.0:1787360308.738917:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213d5 00000100:00080000:0.0:1787360308.738942:0:20980:0:(import.c:65:import_set_state_nolock()) ffff9989037db000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360308.739014:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9989037dd800): rc 0 00000020:00000080:0.0:1787360308.739016:0:20980:0:(genops.c:885:class_export_put()) final put ffff9989037dd800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787360308.739025:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff998a2f240000), last request at 1787360305 00000020:00000080:0.0:1787360308.739029:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72133b 00000100:00080000:0.0:1787360308.739035:0:20980:0:(import.c:65:import_set_state_nolock()) ffff998a2f242800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360308.739041:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a2f240000): rc 0 00000020:00000080:0.0:1787360308.739043:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a2f240000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787360308.739051:0:20980:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4f7819bfae0 00000100:00080000:0.0:1787360308.739073:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360308.739084:0:20980:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff998a3ff44700 x1874182596161536/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787360315 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360308.739099:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360308.739937:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360308.739946:0:20980:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787360308.740113:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787360308.740122:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740150:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360308.740155:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740166:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360308.740178:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360308.740185:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360308.740188:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787360308.740191:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787360308.740397:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740405:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360308.740433:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740440:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740455:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787360308.740459:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740465:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360308.740468:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740482:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360308.740488:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360308.740494:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360308.740496:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787360308.740498:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787360308.740514:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740521:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360308.740540:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740547:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740560:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787360308.740563:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740569:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360308.740572:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740579:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360308.740595:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360308.740601:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360308.740604:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787360308.740606:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787360308.740620:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740626:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360308.740633:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740639:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740653:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360308.740657:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740662:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360308.740665:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740672:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360308.740678:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360308.740693:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787360308.740695:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787360308.740697:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787360308.740712:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740718:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360308.740725:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740730:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740740:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360308.740744:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740750:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360308.740753:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740760:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360308.740766:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360308.740772:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360308.740774:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787360308.740776:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787360308.740795:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740801:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360308.740806:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740823:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360308.740835:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360308.740837:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360308.740839:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360308.740948:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596164864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360308.741030:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360308.741096:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360308.741101:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596164736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360308.741123:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360308.741158:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164864 00000100:00100000:3.0:1787360308.741166:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164864 00000100:00100000:3.0:1787360308.741204:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596164736 00000100:00100000:3.0:1787360308.741207:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596164736 00000100:00100000:3.0:1787360308.741250:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360308.741260:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3661:x1874182596164864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787360308.741267:0:17191:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360308 with bad export cookie 3862485576719667334 00010000:00010000:1.0:1787360308.742170:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360308.742204:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360308.742214:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1874182596164736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787360308.742221:0:17190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360308 with bad export cookie 3862485576719667334 00000100:00100000:1.0:1787360308.742391:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3661:x1874182596164736:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (1264us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360308.742399:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787360308.742469:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787360308.742488:0:3661:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787360308.742493:0:3661:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:2.0:1787360308.742590:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff9989037dd800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787360308.742648:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2f240000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787360308.742677:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989037db000 for lustre-MDT0001 00000020:00000080:2.0:1787360308.742682:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2f242800 for lustre-MDT0001 00000100:00100000:3.0:1787360308.748433:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3661:x1874182596164864:12345-0@lo:103:ldlm_bl.0 Request processed in 7165us (7394us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787360308.748450:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787360308.763925:0:3661:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787360308.763931:0:3661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787360308.763944:0:3661:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904fde680 x1874182596163584/t0(0) o400->MGC192.168.206.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787360321 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360308.763962:0:3661:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2edb8a80 x1874182596164864/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360324 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360308.763972:0:3661:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2edb8e00 x1874182596164736/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360324 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787360308.763982:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787360308.763985:0:3661:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787360308.763986:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360308.764157:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:0:1874182596164992:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787360308.764338:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787360308.764344:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787360308.764361:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787360308.764458:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787360308.764496:0:20980:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787360308.764520:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787360308.764524:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787360308.764533:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787360308.764605:0:20980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787360308.764617:0:20980:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787360308.764662:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff998a3dcb99b8) has no exports 00000100:00100000:3.0:1787360308.764840:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596163584:0@lo:400:kworker.0 00000100:00100000:3.0:1787360308.764870:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596161536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360308.765058:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:0:1874182596164608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360308.765068:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:0:1874182596165120:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787360308.765183:0:3661:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360308.765190:0:3661:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1787360308.765199:0:3661:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a3ff48800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360308.765215:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596165248:0@lo:9:umount.0 00000100:00100000:1.0:1787360308.765321:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360308.765358:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596165376:0@lo:9:umount.0 00000100:00100000:2.0:1787360308.765484:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596165248 00000100:00100000:2.0:1787360308.765495:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596165248 00000100:00100000:2.0:1787360308.765574:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360308.765587:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1874182596165248:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787360308.765619:0:18714:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721365 00000100:00080000:2.0:1787360308.765640:0:18714:0:(import.c:65:import_set_state_nolock()) ffff998902a18800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787360308.765693:0:18714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787360308.765866:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3657:x1874182596165248:12345-0@lo:9:umount.0 Request processed in 280us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360308.765875:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787360308.766031:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360308.766059:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360308.766119:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787360308.766135:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787360308.766138:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360308.766143:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596165248:0@lo:9:umount.0 00000100:00100000:1.0:1787360308.766297:0:3661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff44700 x1874182596165504/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360308.766326:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596165504:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787360308.766360:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596165504 offset 0 length 520: 4 00000100:00100000:1.0:1787360308.766478:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596164864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360308.766491:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596164736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360308.766555:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596165376 00000100:00100000:0.0:1787360308.766561:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596165376 00000100:00100000:0.0:1787360308.766614:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787360308.766624:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1874182596165376:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787360308.766642:0:18711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213f1 00000100:00080000:0.0:1787360308.766650:0:18711:0:(import.c:65:import_set_state_nolock()) ffff998a05831000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787360308.766688:0:18711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787360308.766806:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3657:x1874182596165376:12345-0@lo:9:umount.0 Request processed in 183us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360308.766824:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787360308.766855:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360308.767263:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360308.767291:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787360308.767306:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787360308.767308:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360308.767312:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596165376:0@lo:9:umount.0 00010000:00010000:3.0:1787360308.767799:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787360308.771687:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff998a3dcb99b8) has no exports 00000020:01000000:3.0:1787360308.910957:0:20980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989034fa3c0 - data ffff998a29c38798/ffff998a05877000 00000020:01000000:3.0:1787360308.911472:0:20980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989034fa1e0 - data ffff998a29c6a5e8/ffff998a35bc7800 00000001:00000004:3.0:1787360308.931341:0:20980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1787360308.991566:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360308.991574:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787360308.991581:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787360308.993601:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787360308.993607:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1787360308.993660:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360308.993663:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787360308.998172:0:17947:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787360308.998181:0:17947:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1787360308.998194:0:17947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1787360308.999005:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787360308.999011:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1787360308.999020:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360308.999022:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787360309.002699:0:17950:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787360309.002707:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787360309.002746:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787360309.003916:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7211cf 00000020:00000080:1.0:1787360309.003927:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a2ed9c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787360309.004538:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7211e4 00000020:00000080:0.0:1787360309.004545:0:20980:0:(genops.c:885:class_export_put()) final put ffff998902a58000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360309.005512:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787360309.005600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a58000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787360309.005608:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787360309.005774:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360309.005783:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360309.005787:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff998a3505b370) has no exports 00000004:01000000:1.0:1787360309.005992:0:20980:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787360309.006000:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721238 00000020:00000080:1.0:1787360309.006006:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a042f8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787360309.006020:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787360309.006024:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360309.006038:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787360309.006040:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff998a3c9019b8) has no exports 00000020:00000080:1.0:1787360309.006045:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721231 00000020:00000080:1.0:1787360309.006049:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a042f9000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787360309.006422:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787360309.006425:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787360309.006429:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787360309.006434:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360309.006436:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360309.006471:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360309.006476:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787360309.006481:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721223 00000020:00000080:1.0:1787360309.006485:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a042fa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787360309.006488:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787360309.006491:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360309.006493:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787360309.006495:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff998a3c903370) has no exports 00000020:00000080:1.0:1787360309.006498:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721215 00000020:00000080:1.0:1787360309.006500:0:20980:0:(genops.c:885:class_export_put()) final put ffff998902612800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787360309.006778:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787360309.006780:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787360309.006783:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1787360309.006785:0:20980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360309.006787:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360309.006807:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360309.006821:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787360309.006829:0:20980:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787360309.006832:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721207 00000020:00000080:1.0:1787360309.006836:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a2ed98000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787360309.006839:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787360309.006842:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360309.006844:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787360309.006851:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff998a3594cd28) has no exports 00000020:00000080:1.0:1787360309.006854:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721200 00000020:00000080:1.0:1787360309.006857:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a3784d800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787360309.007253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042f8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787360309.007261:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042f9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787360309.007267:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a042fe000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787360309.007272:0:37:0:(genops.c:885:class_export_put()) final put ffff998a042fc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360309.007274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042fc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787360309.007282:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360309.007354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042fa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787360309.007358:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902612800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787360309.007361:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902614000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787360309.007364:0:37:0:(genops.c:885:class_export_put()) final put ffff998a2f241000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360309.007366:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2f241000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787360309.007369:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360309.007389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed98000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787360309.007392:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3784d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787360309.008569:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787360309.008575:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360309.008578:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787360309.008582:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360309.008625:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360309.008632:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360309.008653:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360309.008655:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360309.008659:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a2ed9f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787360309.008662:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787360309.008670:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360309.008716:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3784b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787360309.008728:0:37:0:(genops.c:885:class_export_put()) final put ffff998a07d7f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360309.008730:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a07d7f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787360309.008735:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360309.009014:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7211eb 00000020:00000080:0.0:1787360309.009021:0:20980:0:(genops.c:885:class_export_put()) final put ffff998902a5b800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787360309.009039:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787360309.009072:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360309.009077:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360309.009080:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff998a3dcbcd28) has no exports 00000020:00000080:0.0:1787360309.009110:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360309.009113:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787360309.009117:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7211f2 00000020:00000080:0.0:1787360309.009121:0:20980:0:(genops.c:885:class_export_put()) final put ffff998902a59000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787360309.009128:0:20980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9989029fe800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787360309.009130:0:20980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9989029fe800 2 00000020:01000004:0.0:1787360309.009133:0:20980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9989029fe800 from lustre-MDT0001 00000020:00000080:0.0:1787360309.009149:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360309.009160:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787360309.009163:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a2ed9d800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787360309.009165:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787360309.009171:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787360309.009203:0:20980:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787360309.009207:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787360309.009209:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360309.009216:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360309.009242:0:20980:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff998a05891000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360309.009247:0:20980:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff998a3dcb8000) has exports, disconnecting them 00000020:00080000:0.0:1787360309.009251:0:20980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff998a05891000), last request at 1787360223 00000020:00000080:0.0:1787360309.009255:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721270 00000020:00080000:0.0:1787360309.009265:0:20980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a05891000): rc 0 00000020:00000080:0.0:1787360309.009268:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a05891000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787360309.010305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787360309.010311:0:37:0:(genops.c:885:class_export_put()) final put ffff998902a5d000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787360309.010313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787360309.010318:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787360309.010417:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a59000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787360309.010421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05891000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787360309.075312:0:20980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787360309.075322:0:20980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360309.075326:0:20980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360309.075333:0:20980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360309.075532:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05894000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787360309.075683:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360309.075692:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787360309.075698:0:20980:0:(genops.c:885:class_export_put()) final put ffff998902a5b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787360309.075702:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787360309.075712:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787360309.075780:0:20980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9989029fe800 1 00000020:00000080:1.0:1787360309.075786:0:20980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721197 00000020:00000080:1.0:1787360309.075793:0:20980:0:(genops.c:885:class_export_put()) final put ffff998a31303800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787360309.075847:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787360309.075851:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360309.075856:0:20980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787360309.075860:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff998a3505cd28) has no exports 00000020:00000080:3.0:1787360309.077546:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a31303800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787360309.177052:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360309.177065:0:20980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787360309.177071:0:20980:0:(genops.c:885:class_export_put()) final put ffff9989029fc800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787360309.177076:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffff9989029fc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787360309.177089:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1787360309.179422:0:20980:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9989029fd000 00000020:01000000:0.0:1787360309.179449:0:20980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787360309.179464:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360309.179470:0:20980:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360309.179474:0:20980:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99890273cd28) has no exports 00000100:00100000:0.0:1787360309.179558:0:17207:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99890260d600:17207] 2 exiting: rc = 0 00000100:00100000:0.0:1787360309.179690:0:17205:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99890293ee00:17205] 0 exiting: rc = 1 00000100:00100000:0.0:1787360309.179772:0:17241:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff998a3c9bde00:17241] 3 exiting: rc = 0 00000100:00100000:0.0:1787360309.179884:0:20605:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9989039e5400:20605] 4 exiting: rc = 0 00000100:00100000:2.0:1787360309.180205:0:17206:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff998a0fe69000:17206] 1 exiting: rc = 0 00000100:00100000:0.0:1787360309.180439:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180446:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180463:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180469:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180475:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180482:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180488:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180492:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180509:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180514:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180520:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180525:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180531:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180536:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180542:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180548:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180553:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180558:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180564:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180569:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180575:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180582:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180587:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180592:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180610:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180616:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180622:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180629:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180634:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180640:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180646:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180651:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180656:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180662:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180669:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180674:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180680:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180686:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180693:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180698:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180705:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180710:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180715:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180729:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180734:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180740:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180745:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180750:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180755:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180760:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180766:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180772:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180777:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180782:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180789:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180796:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180802:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180819:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180826:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180832:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180838:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180844:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180850:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.180855:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360309.183333:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99890260cc00:17208] 0 exiting: rc = 1 00000100:00100000:2.0:1787360309.183383:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff998a02e1e400:17209] 1 exiting: rc = 0 00000100:00100000:0.0:1787360309.189322:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189332:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189341:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189349:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189355:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189362:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189366:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189373:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189379:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189388:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189398:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189407:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189414:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189420:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189443:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189449:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189455:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189461:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189466:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189473:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189481:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189487:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189495:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189505:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189513:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189520:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189525:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189530:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189534:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189540:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189545:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189551:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189555:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189560:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189565:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189570:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189576:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189581:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189587:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189592:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189598:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189603:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189608:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189614:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189619:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189624:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189629:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189634:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189639:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189651:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189656:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189661:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189666:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189671:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189676:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189681:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189687:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189692:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189698:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189704:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189709:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189715:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189720:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360309.189725:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.198163:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff998a1a545800:17210] 0 exiting: rc = 1 00000100:00100000:1.0:1787360309.198775:0:17948:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff998a042ef000:17948] 2 exiting: rc = 0 00000100:00100000:3.0:1787360309.203785:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff998a090d7e00:17211] 1 exiting: rc = 0 00000100:00100000:2.0:1787360309.206721:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206732:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206738:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206745:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206750:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206756:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206762:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206769:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206774:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206781:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206787:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206804:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206821:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206827:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206833:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206841:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206847:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206853:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206860:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206868:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206873:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206880:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206885:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206904:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206921:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206927:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206933:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206941:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206946:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206952:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206958:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206965:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206971:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206978:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.206984:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207003:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207010:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207016:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207022:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207028:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207033:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207038:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207044:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207050:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207056:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207061:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207068:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207086:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207093:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207114:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207120:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207126:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207132:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207137:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207142:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207149:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207155:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207161:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207167:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207193:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207199:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207205:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207211:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360309.207217:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230295:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff998a090d7400:17213] 1 exiting: rc = 0 00000100:00100000:1.0:1787360309.230443:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff998a090d6200:17212] 0 exiting: rc = 1 00000100:00100000:3.0:1787360309.230598:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230605:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230610:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230615:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230622:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230627:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230632:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230637:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230643:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230648:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230653:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230658:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230663:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230668:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230673:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230678:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230683:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230688:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230705:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230710:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230715:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230720:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230725:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230730:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230735:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230740:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230745:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230750:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230754:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230759:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230764:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230768:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230773:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230778:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230783:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230788:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230794:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230799:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230804:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230820:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230825:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230831:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230836:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230841:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230845:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230850:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230855:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230860:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230865:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230870:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230875:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230881:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230885:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230896:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230900:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230906:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230911:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230916:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230920:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230925:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230929:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230934:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230939:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.230944:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360309.231767:0:17215:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff998a090d6000:17215] 1 exiting: rc = 0 00000100:00100000:3.0:1787360309.231866:0:17214:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff998a090d6c00:17214] 0 exiting: rc = 1 00000100:00100000:3.0:1787360309.231912:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231918:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231924:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231929:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231934:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231939:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231944:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231949:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231955:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231960:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231966:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231971:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231976:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231981:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231986:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231992:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.231997:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232003:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232008:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232013:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232018:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232023:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232027:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232041:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232046:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232052:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232057:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232062:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232067:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232072:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232077:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232082:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232087:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232092:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232097:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232221:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232489:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232495:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232499:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232503:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232508:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232512:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232516:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232522:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232527:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232531:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232537:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232542:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232547:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232551:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232556:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232561:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232566:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232571:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232575:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232580:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232586:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232591:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232604:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232609:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232614:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232618:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232623:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.232627:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360309.233011:0:17216:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff998902b3d400:17216] 0 exiting: rc = 1 00000100:00100000:1.0:1787360309.233085:0:17217:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff998902b3c200:17217] 1 exiting: rc = 0 00000100:00100000:3.0:1787360309.233265:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233271:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233276:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233282:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233287:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233292:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233296:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233301:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233305:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233310:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233314:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233318:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233322:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233327:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233331:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233336:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233340:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233345:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233349:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233355:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233360:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233365:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233369:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233374:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233379:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233383:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233388:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233393:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233398:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233412:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233416:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233420:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233425:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233429:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233435:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233440:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233444:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233448:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233453:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233457:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233462:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233467:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233472:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233477:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233482:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233486:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233491:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233495:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233500:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233504:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233509:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233515:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233520:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233525:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233529:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233533:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233538:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233543:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233548:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233552:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233556:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233561:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233566:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233570:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.233967:0:17218:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff998a0fe69400:17218] 0 exiting: rc = 1 00000100:00100000:2.0:1787360309.236875:0:17219:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff998a0fe68c00:17219] 1 exiting: rc = 0 00000100:00100000:2.0:1787360309.237072:0:17220:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9989041e4800:17220] 2 exiting: rc = 0 00000100:00100000:3.0:1787360309.237342:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237361:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237369:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237374:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237380:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237386:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237392:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237397:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237402:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237408:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237413:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237418:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237422:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237428:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237433:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237439:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237445:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237451:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237456:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237462:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237468:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237474:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237480:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237486:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237493:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237515:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237523:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237530:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237536:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237540:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237546:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237550:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237555:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237561:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237579:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237585:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237592:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237597:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237602:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237607:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237612:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237617:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237622:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237628:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237633:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237639:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237644:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237650:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237656:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237675:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237682:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237688:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237693:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237699:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237705:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237710:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237716:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237722:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237728:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237733:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237739:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237745:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237750:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360309.237762:0:20980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787360309.255049:0:20980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360309.255062:0:20980:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787360309.255067:0:20980:0:(genops.c:885:class_export_put()) final put ffff9989041ab800/MDS_uuid 00000020:00000080:2.0:1787360309.255072:0:20980:0:(genops.c:844:class_export_destroy()) destroying export ffff9989041ab800/MDS_uuid for MDS 00000020:01000000:2.0:1787360309.255077:0:20980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787360309.256485:0:20980:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787360309.690798:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787360310.521284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360310.521292:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360310.521296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360310.521307:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787360310.521310:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360310.521317:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1787360310.521323:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787360310.521330:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998a2f243800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360310.521362:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5c700 x1874182596165632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360310.521492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360310.521495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787360310.521497:0:37:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360310.521501:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 583 00000100:00080000:3.0:1787360310.521504:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787360310.521508:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9989035fd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360310.521520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5e300 x1874182596165888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360310.521551:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596165760:0@lo:400:kworker.0 00000100:00100000:2.0:1787360310.521695:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596165632:0@lo:38:kworker.0 00000400:00000100:2.0:1787360310.521737:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596165632 offset 0 length 520: 4 00000400:00000100:3.0:1787360310.521766:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596165760 offset 0 length 224: 4 00000100:00100000:2.0:1787360310.521770:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596165888:0@lo:38:kworker.0 00000100:00100000:3.0:1787360310.521791:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000400:00000100:2.0:1787360310.521794:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596165888 offset 0 length 520: 4 00000100:00100000:3.0:1787360310.521874:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596166016:0@lo:400:kworker.0 00000400:00000100:3.0:1787360310.521894:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166016 offset 0 length 224: 4 00010000:00010000:3.0:1787360310.713842:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360311.737811:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360312.764995:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787360313.129059:0:21181:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787360313.138696:0:21181:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787360313.138753:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360313.138769:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360313.138778:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360313.138786:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360313.138835:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787360313.138841:0:21181:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787360313.138864:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360313.138875:0:21181:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2ee5c700 x1874182596165632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360313.138904:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787360313.138911:0:21181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787360313.138917:0:21181:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787360313.138923:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360313.138927:0:21181:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2ee5c700 x1874182596165632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360330 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360313.138935:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787360313.138938:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1787360313.139146:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596165632:0@lo:38:kworker.0 00010000:00010000:0.0:1787360313.139264:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360313.139272:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360313.139281:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360313.139285:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360313.139294:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360313.139301:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360313.139307:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787360313.139310:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787360313.139320:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787360313.139697:0:17193:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:0.0:1787360313.139703:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360313.139710:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360313.139723:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360313.139725:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360313.139726:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360313.142451:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787360313.142469:0:21181:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2ee5c380 x1874182596165760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360326 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360313.142494:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787360313.142501:0:21181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787360313.142530:0:21181:0:(import.c:65:import_set_state_nolock()) ffff998902a1d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787360313.142574:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596165760:0@lo:400:kworker.0 00000100:00100000:0.0:1787360313.142604:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596166144:0@lo:39:umount.0 00000400:00000100:0.0:1787360313.142650:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166144 offset 0 length 224: 4 00000100:00080000:1.0:1787360313.529354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360313.529363:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360313.529366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360313.529369:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360313.529476:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360313.529496:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596166272:0@lo:400:kworker.0 00000400:00000100:0.0:1787360313.529548:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166272 offset 0 length 224: 4 00010000:00010000:3.0:1787360313.785763:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787360314.619833:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787360314.619842:0:18708:0:(genops.c:885:class_export_put()) final put ffff998902a19800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787360314.619936:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a19800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787360314.619985:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a18800 for lustre-OST0000 00000001:00100000:3.0:1787360314.620206:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360314.620210:0:19526:0:(genops.c:885:class_export_put()) final put ffff998a05831800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787360314.620293:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05831800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787360314.620320:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a05831000 for lustre-OST0001 00010000:00010000:1.0:1787360314.809697:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787360315.577400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360315.577410:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360315.577413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360315.577416:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360315.577624:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360315.577645:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596166400:0@lo:400:kworker.0 00000400:00000100:3.0:1787360315.577695:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166400 offset 0 length 224: 4 00010000:00010000:3.0:1787360315.833472:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360316.857443:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360317.881370:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360318.265407:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360308/real 1787360308] req@ffff998a3ff44700 x1874182596165504/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787360318 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360318.265441:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a3ff44700 x1874182596165504/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787360318 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360318.265987:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360318.266010:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787360318.266014:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596165504:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1787360318.266101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360318.266106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787360318.266108:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360318.266113:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 587 00000100:00080000:1.0:1787360318.266117:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360318.266122:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a3ff48800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360318.266147:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff44700 x1874182596166528/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360318.266167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360318.266170:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360318.266268:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596166656:0@lo:400:kworker.0 00000400:00000100:3.0:1787360318.266314:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166656 offset 0 length 224: 4 00000100:00100000:0.0:1787360318.266395:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596166528:0@lo:250:kworker.0 00000400:00000100:0.0:1787360318.266418:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596166528 offset 0 length 520: 4 00010000:00010000:1.0:1787360318.905523:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360319.929707:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360320.954144:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360321.977448:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360323.003504:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360323.321768:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360323.321778:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360323.321781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787360323.321799:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360323.321917:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596166784:0@lo:400:kworker.0 00000400:00000100:2.0:1787360323.321968:0:3661:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166784 offset 0 length 224: 4 00000100:00100000:0.0:1787360323.386017:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360313/real 1787360313] req@ffff998904fddf80 x1874182596166144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360323 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360323.386047:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904fddf80 x1874182596166144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360323 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360323.386066:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a1d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787360323.386086:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596166144:0@lo:39:umount.0 00000100:00080000:2.0:1787360323.388266:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787360323.388273:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787360323.388293:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787360323.389167:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389181:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389189:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389196:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389222:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360323.389259:0:21181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389266:0:21181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389272:0:21181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389278:0:21181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360323.389295:0:21181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787360323.389299:0:21181:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787360323.389321:0:21181:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787360323.389325:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787360323.389329:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360323.389341:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787360323.389344:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff998a3dcbb370) has no exports 00000020:00080000:2.0:1787360323.389367:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff998a3dcbb370) has no exports 00010000:00010000:3.0:1787360323.391253:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360323.391265:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391275:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360323.391279:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391289:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360323.391295:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360323.391301:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360323.391303:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787360323.391318:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787360323.391339:0:17194:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:3.0:1787360323.391342:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391348:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391362:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360323.391365:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391370:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360323.391373:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391379:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360323.391385:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360323.391390:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787360323.391391:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787360323.391393:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787360323.391399:0:17194:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:3.0:1787360323.391402:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391407:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360323.391426:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360323.391428:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360323.391430:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360323.391663:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787360323.395802:0:21181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a3bb1c060 - data ffff998a29c671b0/ffff998a3c29ac00 00000020:01000000:2.0:1787360323.395950:0:21181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a3c89fd80 - data ffff998a29c01438/ffff998904394800 00100000:10000000:2.0:1787360323.406990:0:21181:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787360323.420599:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7212f5 00000020:00000080:2.0:1787360323.420611:0:21181:0:(genops.c:885:class_export_put()) final put ffff998a05a0e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787360323.420631:0:21181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a042ae800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787360323.420635:0:21181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a042ae800 2 00000020:01000004:2.0:1787360323.420638:0:21181:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a042ae800 from lustre-OST0000 00000020:00000080:2.0:1787360323.420663:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360323.420671:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787360323.420674:0:21181:0:(genops.c:885:class_export_put()) final put ffff998a05a0d000/lustre-OST0000_UUID 00000020:00000080:2.0:1787360323.420676:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05a0d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787360323.420683:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787360323.420727:0:21181:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787360323.420731:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787360323.420746:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360323.420751:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787360323.420757:0:21181:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff998a042ac000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360323.420763:0:21181:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff998a34550000) has exports, disconnecting them 00000020:00080000:2.0:1787360323.420767:0:21181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff998a042ac000), last request at 1787360237 00000020:00000080:2.0:1787360323.420771:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72131f 00000020:00080000:2.0:1787360323.420780:0:21181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a042ac000): rc 0 00000020:00000080:2.0:1787360323.420784:0:21181:0:(genops.c:885:class_export_put()) final put ffff998a042ac000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787360323.421472:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05a0e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787360323.421487:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042ac000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787360323.433599:0:21181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787360323.433607:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360323.433611:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787360323.433617:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360323.433825:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360323.433834:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787360323.433840:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787360323.433844:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360323.433848:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360323.433855:0:21181:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff998902a1b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360323.433860:0:21181:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff998a345519b8) has exports, disconnecting them 00000020:00080000:0.0:1787360323.433865:0:21181:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff998902a1b800), last request at 1787360237 00000020:00000080:0.0:1787360323.433868:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721334 00000020:00080000:0.0:1787360323.433893:0:21181:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998902a1b800): rc 0 00000020:00000080:0.0:1787360323.433898:0:21181:0:(genops.c:885:class_export_put()) final put ffff998902a1b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787360323.435049:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2f243800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787360323.435060:0:37:0:(genops.c:885:class_export_put()) final put ffff998a043a0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787360323.435063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787360323.435178:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787360323.435315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a1b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787360323.435343:0:21181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787360323.435347:0:21181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787360323.435350:0:21181:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360323.435355:0:21181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360323.435372:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a1d000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787360323.435510:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360323.435517:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787360323.435521:0:21181:0:(genops.c:885:class_export_put()) final put ffff998902a5d800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787360323.435523:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787360323.435528:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787360323.435552:0:21181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a042ae800 1 00000020:00000080:1.0:1787360323.435558:0:21181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7212d2 00000020:00000080:1.0:1787360323.435563:0:21181:0:(genops.c:885:class_export_put()) final put ffff998a043a3000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787360323.435645:0:21181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787360323.435653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787360323.435662:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360323.435666:0:21181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360323.435670:0:21181:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff998a35948000) has no exports 00000020:00000080:1.0:1787360323.529106:0:21181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360323.529128:0:21181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787360323.529133:0:21181:0:(genops.c:885:class_export_put()) final put ffff998a042aa800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787360323.529136:0:21181:0:(genops.c:844:class_export_destroy()) destroying export ffff998a042aa800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787360323.529147:0:21181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787360323.529284:0:21181:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998a042ab800 00000020:02000400:1.0:1787360323.529327:0:21181:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787360324.028114:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360325.049974:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.073527:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787360326.393372:0:3660:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360310/real 1787360310] req@ffff998a2ee5d880 x1874182596166016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360326 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360326.426187:0:3660:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff998a2ee5d880 x1874182596166016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360326 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360326.426204:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9989035f8000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787360326.426209:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787360326.449620:0:3660:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:3.0:1787360326.449703:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596166016:0@lo:400:kworker.0 00000100:00080000:2.0:1787360326.454095:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360326.454104:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360326.454107:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360326.454117:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360326.454119:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360326.454122:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787360326.454125:0:14779:0:(import.c:65:import_set_state_nolock()) ffff9989035f8000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360326.454134:0:14779:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1787360326.454142:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9989035f8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360326.454179:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fddf80 x1874182596166912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360326.459131:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596166912:0@lo:38:kworker.0 00000400:00000100:0.0:1787360326.459187:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596166912 offset 0 length 520: 4 00000020:01000004:1.0:1787360326.596841:0:21383:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360326.602414:0:21383:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787360326.602493:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.602507:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.602515:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.602522:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.602545:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360326.602550:0:21383:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787360326.602588:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360326.602594:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.602602:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360326.602605:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.602624:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360326.602631:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360326.602636:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360326.602639:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787360326.602641:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787360326.602654:0:17193:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:1.0:1787360326.602657:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.602664:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.602856:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.602858:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.602860:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787360326.603143:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360326.603155:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2ee5e300 x1874182596165888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360330 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.603176:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360326.603181:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360326.603186:0:21383:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787360326.603191:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360326.603195:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2ee5e300 x1874182596165888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360330 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.603212:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787360326.603289:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596165888:0@lo:38:kworker.0 00000100:00100000:0.0:1787360326.603299:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00080000:0.0:1787360326.604448:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360326.604458:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff44e00 x1874182596166272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360329 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604918:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904174000 x1874182596166400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360331 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604930:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff44a80 x1874182596166656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604940:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff47b80 x1874182596166784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360339 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604952:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904fddf80 x1874182596166912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360336 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604962:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360326.604967:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787360326.604972:0:21383:0:(import.c:65:import_set_state_nolock()) ffff9989035f8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787360326.604976:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360326.604980:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff44e00 x1874182596166272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360329 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604987:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904174000 x1874182596166400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360331 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.604994:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff44a80 x1874182596166656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360334 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.605000:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff47b80 x1874182596166784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360339 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.605006:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904fddf80 x1874182596166912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360336 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360326.605022:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360326.605025:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1787360326.605323:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596166912:0@lo:38:kworker.0 00000100:00100000:3.0:1787360326.606183:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596166272:0@lo:400:kworker.0 00000100:00100000:3.0:1787360326.606522:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596166400:0@lo:400:kworker.0 00000100:00100000:3.0:1787360326.606632:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596166656:0@lo:400:kworker.0 00000100:00100000:2.0:1787360326.607340:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596166784:0@lo:400:kworker.0 00010000:00010000:0.0:1787360326.610191:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610207:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610214:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610221:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610249:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360326.610255:0:21383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610262:0:21383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610268:0:21383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610275:0:21383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360326.610289:0:21383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787360326.610292:0:21383:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787360326.610333:0:21383:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787360326.610338:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787360326.610341:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360326.610346:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360326.610350:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff998902ba99b8) has no exports 00000020:00080000:0.0:1787360326.610372:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff998902ba99b8) has no exports 00010000:00010000:2.0:1787360326.610607:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360326.610608:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360326.610618:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610626:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360326.610630:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610638:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360326.610645:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360326.610651:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787360326.610654:0:17194:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787360326.610656:0:17194:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787360326.610671:0:17194:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:1.0:1787360326.610674:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610681:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610709:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.610711:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.610713:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360326.610772:0:21384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360326.610775:0:21384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360326.610777:0:21384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.610834:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610841:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360326.610844:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610851:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360326.610856:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360326.610861:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360326.610863:0:17193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787360326.610865:0:17193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787360326.610872:0:17193:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:1.0:1787360326.610874:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610880:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.610889:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.610891:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360326.610892:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787360326.613527:0:21383:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a3bb1cd80 - data ffff998a29d83438/ffff998a10bf1400 00000020:01000000:0.0:1787360326.613689:0:21383:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989034fa8a0 - data ffff998a29c65288/ffff998a043b7800 00100000:10000000:0.0:1787360326.626850:0:21383:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787360326.634252:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72138f 00000020:00000080:1.0:1787360326.634265:0:21383:0:(genops.c:885:class_export_put()) final put ffff998a043a3800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787360326.634290:0:21383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998903b0b000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787360326.634294:0:21383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998903b0b000 2 00000020:01000004:1.0:1787360326.634298:0:21383:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998903b0b000 from lustre-OST0001 00000020:00000080:2.0:1787360326.634541:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787360326.634610:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360326.634621:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787360326.634624:0:21383:0:(genops.c:885:class_export_put()) final put ffff998a043a1800/lustre-OST0001_UUID 00000020:00000080:1.0:1787360326.634627:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787360326.634634:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787360326.634762:0:21383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS 00010000:00010000:1.0:1787360326.634966:0:21383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360326.634980:0:21383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360326.634990:0:21383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787360326.634993:0:21383:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787360326.634996:0:21383:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787360326.635009:0:21383:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:1.0:1787360326.635012:0:21383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360326.635027:0:21383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360326.635034:0:21383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360326.635039:0:21383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360326.635042:0:21383:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787360326.635155:0:21383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787360326.635167:0:21383:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a3ff48800 00010000:00010000:1.0:1787360326.635171:0:21383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787360326.635261:0:21383:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787360326.635266:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787360326.635269:0:21383:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787360326.635271:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787360326.635276:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787360326.635287:0:21383:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a3ff44700 x1874182596166528/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787360333 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787360326.635308:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360326.635377:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596166528:0@lo:250:kworker.0 00000100:00100000:1.0:1787360326.635554:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787360326.635557:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787360326.635565:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721078 00000020:00000080:1.0:1787360326.635571:0:21383:0:(genops.c:885:class_export_put()) final put ffff9989041a9800/9b5a46b1-7024-40db-b9fb-69c8c09a9227 00000020:01000000:1.0:1787360326.635586:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.111@tcp (flags='') 00000020:00000080:1.0:1787360326.635594:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360326.635600:0:21383:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787360326.635603:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff998a35058000) has no exports 00000020:00000080:2.0:1787360326.635631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9989041a9800/9b5a46b1-7024-40db-b9fb-69c8c09a9227 for MGC192.168.206.111@tcp 10000000:01000000:3.0:1787360326.635655:0:17202:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787360326.635750:0:21383:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.111@tcp: client import never connected 00000100:00080000:1.0:1787360326.635753:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787360326.635755:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787360326.635757:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787360326.635759:0:21383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787360326.635972:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360326.635977:0:21383:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.111@tcp (uuid 9b5a46b1-7024-40db-b9fb-69c8c09a9227) 00000020:01000000:1.0:1787360326.635983:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787360326.635987:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360326.635990:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3ff48800 for MGC192.168.206.111@tcp 00000020:00000080:1.0:1787360326.635991:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787360326.636000:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9989035fb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:2.0:1787360326.636001:0:37:0:(genops.c:885:class_export_put()) final put ffff998a3ff4b800/9b5a46b1-7024-40db-b9fb-69c8c09a9227 00000020:00000080:2.0:1787360326.636007:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3ff4b800/9b5a46b1-7024-40db-b9fb-69c8c09a9227 for MGC192.168.206.111@tcp 00000020:01000000:2.0:1787360326.636012:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.111@tcp (9b5a46b1-7024-40db-b9fb-69c8c09a9227) 00000020:00080000:1.0:1787360326.636022:0:21383:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9989038e0000) has exports, disconnecting them 00000020:00080000:1.0:1787360326.636027:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9989035fb000), last request at 1787360253 00000020:00000080:1.0:1787360326.636031:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213b9 00000020:00080000:1.0:1787360326.636268:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9989035fb000): rc 0 00000020:00000080:1.0:1787360326.636275:0:21383:0:(genops.c:885:class_export_put()) final put ffff9989035fb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787360326.636347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9989035fb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787360326.640427:0:21383:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787360326.640437:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360326.640441:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787360326.640449:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360326.640620:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989035fd800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787360326.640666:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360326.640674:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787360326.640679:0:21383:0:(genops.c:885:class_export_put()) final put ffff9989035f8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787360326.640683:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff9989035f8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787360326.640689:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787360326.640754:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787360326.640758:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360326.640763:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787360326.640772:0:21383:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9989035fc800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360326.640777:0:21383:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9989038e3370) has exports, disconnecting them 00000020:00080000:2.0:1787360326.640781:0:21383:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9989035fc800), last request at 1787360253 00000020:00000080:2.0:1787360326.640784:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7213ce 00000020:00080000:2.0:1787360326.640797:0:21383:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9989035fc800): rc 0 00000020:00000080:2.0:1787360326.640801:0:21383:0:(genops.c:885:class_export_put()) final put ffff9989035fc800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787360326.640985:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff9989035fc800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787360326.642345:0:21383:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787360326.642351:0:21383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787360326.642355:0:21383:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787360326.642360:0:21383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360326.642387:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989035f8000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787360326.702120:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787360326.735626:0:21384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787360326.735777:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787360326.735886:0:17188:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff998a3b98c000:17188] 0 exiting: rc = 1 00000100:00100000:0.0:1787360326.738771:0:17189:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff998a3c9e9400:17189] 1 exiting: rc = 0 00000100:00100000:3.0:1787360326.738847:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739159:0:17191:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff998a03055600:17191] 1 exiting: rc = 0 00000100:00100000:0.0:1787360326.739193:0:17192:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff998a03055800:17192] 2 exiting: rc = 0 00000100:00100000:3.0:1787360326.739282:0:17190:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff998a3c9e8800:17190] 0 exiting: rc = 1 00000100:00100000:1.0:1787360326.739291:0:20233:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff998a043cee00:20233] 3 exiting: rc = 0 00000100:00100000:3.0:1787360326.739348:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739435:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739442:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739448:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739455:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739461:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739466:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739471:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739477:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739482:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739488:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739493:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739498:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739504:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739509:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739515:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739521:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739526:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739532:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739537:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739542:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739548:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739554:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739559:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739564:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739569:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739574:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739579:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739585:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739590:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739595:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739601:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739606:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739621:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739626:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739632:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739637:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739643:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739648:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739653:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739659:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739664:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739670:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739676:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739681:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739686:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739701:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739706:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739711:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739725:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739731:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739736:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739741:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739747:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739751:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739756:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739762:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739766:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739771:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739776:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739781:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739786:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739791:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.739797:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787360326.740625:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360326.740634:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787360326.740640:0:21383:0:(genops.c:885:class_export_put()) final put ffff9989035f9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787360326.740644:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff9989035f9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787360326.740657:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787360326.741037:0:21383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998903b0b000 1 00000020:00000080:3.0:1787360326.741044:0:21383:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee721373 00000020:00000080:3.0:1787360326.741050:0:21383:0:(genops.c:885:class_export_put()) final put ffff998a05830800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787360326.741061:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787360326.741064:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360326.741069:0:21383:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787360326.741073:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff998a3594b370) has no exports 00000020:00000080:0.0:1787360326.741213:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a05830800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787360326.805002:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360326.805015:0:21383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787360326.805020:0:21383:0:(genops.c:885:class_export_put()) final put ffff998903b0c000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787360326.805025:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff998903b0c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787360326.805036:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787360326.806037:0:21383:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998903b09000 00000020:01000000:1.0:1787360326.806127:0:21383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787360326.806133:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360326.806139:0:21383:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360326.806143:0:21383:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff998a34554d28) has no exports 00000020:00000080:1.0:1787360326.806178:0:21383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360326.806186:0:21383:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787360326.806190:0:21383:0:(genops.c:885:class_export_put()) final put ffff998a043a6800/OSS_uuid 00000020:00000080:1.0:1787360326.806192:0:21383:0:(genops.c:844:class_export_destroy()) destroying export ffff998a043a6800/OSS_uuid for OSS 00000020:01000000:1.0:1787360326.806202:0:21383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787360326.806385:0:19590:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff998903700800:19590] 4 exiting: rc = 0 00000100:00100000:3.0:1787360326.806391:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff998a3c9be800:18711] 0 exiting: rc = 1 00000100:00100000:3.0:1787360326.806483:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9989034af600:18713] 1 exiting: rc = 0 00000100:00080000:0.0:1787360326.806503:0:17200:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787360326.806514:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9989034ae800:18714] 2 exiting: rc = 0 00000100:00100000:0.0:1787360326.812561:0:19239:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff998904075000:19239] 3 exiting: rc = 0 00000100:00100000:1.0:1787360326.812735:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812744:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812750:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812756:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812761:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812767:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812772:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812778:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812784:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812789:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812795:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812800:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812819:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812824:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812829:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812835:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812840:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812845:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812851:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812856:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812862:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812867:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812873:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812878:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812890:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812896:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812901:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812906:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812912:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812917:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812923:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812928:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812934:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812939:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812944:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812950:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812957:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812962:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812968:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812974:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812979:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812984:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812990:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.812996:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813001:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813006:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813012:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813025:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813030:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813036:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813041:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813046:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813051:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813057:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813063:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813068:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813074:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813078:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813084:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813089:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813095:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813100:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813105:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.813117:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.819431:0:18716:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9989034ae000:18716] 1 exiting: rc = 0 00000100:00100000:1.0:1787360326.822572:0:18715:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9989034afa00:18715] 0 exiting: rc = 1 00000100:00100000:1.0:1787360326.823299:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823307:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823311:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823330:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823335:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823341:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823346:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823351:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823356:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823362:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823367:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823372:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823393:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823400:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823405:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823411:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823427:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823432:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823437:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823443:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823447:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823452:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823457:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823463:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823468:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823473:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823478:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823483:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823488:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823493:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823498:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823503:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823508:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823514:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823519:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823524:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823529:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823534:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823540:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823546:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823617:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823624:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823629:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823633:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823638:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823643:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823648:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823653:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823657:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823662:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823667:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823681:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823685:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823729:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823737:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823743:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823748:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823753:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823758:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823763:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823769:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823775:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823780:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.823786:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360326.826713:0:18718:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9989034af400:18718] 1 exiting: rc = 0 00000100:00100000:2.0:1787360326.827751:0:18717:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9989034aee00:18717] 0 exiting: rc = 1 00000100:00100000:2.0:1787360326.827928:0:18719:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff998a3dcb6600:18719] 2 exiting: rc = 0 00000100:00100000:0.0:1787360326.831562:0:20346:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff998a35ae1e00:20346] 3 exiting: rc = 0 00000100:00100000:2.0:1787360326.831781:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831788:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831793:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831798:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831804:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831810:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831815:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831821:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831827:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831832:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831838:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831844:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831850:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831869:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831875:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831880:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831886:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831892:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831897:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831903:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831909:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831925:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831932:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831938:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831943:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831949:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831955:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831961:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831967:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831973:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831978:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831983:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831989:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831993:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.831998:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832003:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832008:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832013:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832018:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832023:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832030:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832038:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832043:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832049:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832055:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832077:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832084:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832089:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832101:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832106:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832110:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832116:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832121:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832127:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832133:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832138:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832144:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832149:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832154:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832159:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832164:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832170:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832175:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.832188:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360326.846973:0:18720:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff998a059d0200:18720] 0 exiting: rc = 1 00000100:00100000:0.0:1787360326.847306:0:18721:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff998a059d1400:18721] 1 exiting: rc = 0 00000100:00100000:3.0:1787360326.847709:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847728:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847734:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847739:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847744:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847750:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847755:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847760:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847765:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847770:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847775:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847780:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847785:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847789:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847794:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847799:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847803:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847808:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847812:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847817:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847822:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847827:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847832:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847836:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847852:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847857:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847862:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847867:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847871:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847876:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847881:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847886:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847891:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847895:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847900:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847906:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847910:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847916:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847921:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847926:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847930:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847935:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847940:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847945:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847950:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847955:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847959:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847964:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847968:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847973:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847978:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847982:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847987:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847993:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.847998:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848004:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848010:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848015:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848020:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848032:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848037:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848042:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848047:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848057:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848707:0:18723:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff998a042ee400:18723] 1 exiting: rc = 0 00000100:00100000:0.0:1787360326.848785:0:18722:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff998a042efc00:18722] 0 exiting: rc = 1 00000100:00100000:3.0:1787360326.848826:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848835:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848853:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848861:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848866:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848871:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848878:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848901:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848907:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848913:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848918:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848924:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848929:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848934:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848939:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848945:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848951:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848956:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848962:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848981:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848988:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848993:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.848998:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849004:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849010:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849016:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849021:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849028:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849034:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849047:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849053:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849071:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849077:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849082:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849088:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849094:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849099:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849104:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849110:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849116:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849121:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849127:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849133:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849152:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849158:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849164:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849169:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849175:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849181:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849186:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849190:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849195:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849200:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849206:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849212:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849253:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849261:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849266:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849272:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849278:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849284:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849291:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849299:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360326.849312:0:21383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787360326.859033:0:21383:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787360347.727118:0:22148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787360358.468779:0:22748:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787360358.468785:0:22748:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787360358.468786:0:22748:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787360358.469422:0:22748:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a05a04000 00000020:01000004:3.0:1787360358.469440:0:22748:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787360358.469448:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787360358.469462:0:22748:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9989034d0000) 00000020:00000080:3.0:1787360358.469476:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787360358.572274:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787360358.581438:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787360358.589997:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.590954:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.593216:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.594111:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.594949:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.595220:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.595583:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.595768:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.596046:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.596258:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.596427:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.596697:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787360358.600666:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1787360358.601992:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1787360358.602262:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787360358.602510:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1787360358.602760:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.609812:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.610470:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.610703:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.612766:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.614326:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.615003:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.615965:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.617342:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.617924:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.620018:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.620958:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.621411:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787360358.621667:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787360358.621957:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.623803:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.624438:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.624913:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.625973:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.629030:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.630057:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.632044:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.633328:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.633661:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.633923:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.634505:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.637279:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.637747:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787360358.638364:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787360358.642760:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787360358.646126:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787360358.646614:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787360358.647115:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787360358.647390:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787360358.647601:0:22748:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1787360358.651033:0:22748:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787360358.651299:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787360358.651308:0:22748:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787360358.651323:0:22748:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7218e4 00000020:01000004:2.0:1787360358.651332:0:22748:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787360358.651338:0:22748:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787360358.651345:0:22748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a05a04000 from MGS 00000020:01000004:2.0:1787360358.651349:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787360358.651359:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9989038e0000) 00000020:00000080:2.0:1787360358.651370:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787360358.651436:0:22748:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a05a04000 from MGS, refs=2 00080000:01000000:2.0:1787360358.651441:0:22748:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787360358.651446:0:22748:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7218f2 00000100:00100000:2.0:1787360358.651561:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787360358.651686:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787360358.651692:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787360358.652632:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787360358.652639:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787360358.653496:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360358.653662:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787360358.653671:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787360358.654353:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787360358.654359:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787360358.654652:0:22748:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787360358.654658:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787360358.655495:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360358.655498:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360358.655500:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360358.655753:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360358.655756:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360358.655757:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360358.656305:0:22748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787360358.659983:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787360358.662014:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787360358.666515:0:22760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787360358.666926:0:22748:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787360358.666996:0:22748:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787360358.669343:0:22748:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787360358.669709:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360358.672135:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787360358.672148:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787360358.678419:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787360358.678434:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787360358.678916:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787360358.678923:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787360358.682418:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787360358.682444:0:22748:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.111@tcp' 00000020:01000004:3.0:1787360358.682445:0:22748:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787360358.682491:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.111@tcp (typ=mgc) 00000020:00000080:3.0:1787360358.682504:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.111@tcp (ffff9989034d3370) 00000020:00000080:3.0:1787360358.682520:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787360358.682610:0:22748:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a05a07000@MGC192.168.206.111@tcp: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787360358.682750:0:22748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.111@tcp-0 is initialized 00000040:01000000:3.0:1787360358.682755:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787360358.685426:0:22767:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787360358.685476:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.111@tcp (uuid 68392ef7-c60d-4fc0-a5e6-6a46b1db50be) 00000020:00000080:3.0:1787360358.685499:0:22748:0:(genops.c:1385:class_connect()) connect: client 68392ef7-c60d-4fc0-a5e6-6a46b1db50be, cookie 0x359a4e2aee721900 00000100:00080000:3.0:1787360358.685512:0:22748:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360358.685518:0:22748:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a05a07000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360358.685557:0:22748:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5e680 x1874182596167040/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360358.685579:0:22748:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 68392ef7-c60d-4fc0-a5e6-6a46b1db50be->MGS 00000020:01000004:3.0:1787360358.685595:0:22748:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787360358.685608:0:22748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787360358.685621:0:22748:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9989034d19b8) 00000020:00000080:3.0:1787360358.685634:0:22748:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787360358.686377:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3657:1874182596167040:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787360358.686450:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360358.690774:0:22765:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1787360358.691347:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167040 00000100:00100000:2.0:1787360358.691358:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167040 00000100:00100000:2.0:1787360358.691394:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360358.691402:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1874182596167040:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787360358.691428:0:22761:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 68392ef7-c60d-4fc0-a5e6-6a46b1db50be@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1787360358.691454:0:22761:0:(genops.c:1385:class_connect()) connect: client 68392ef7-c60d-4fc0-a5e6-6a46b1db50be, cookie 0x359a4e2aee72190e 00000100:00080000:2.0:1787360358.691596:0:22761:0:(import.c:65:import_set_state_nolock()) ffff99890384a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360358.691680:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:3657:x1874182596167040:12345-0@lo:250:mount.lustre.0 Request processed in 277us (5229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.691687:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360358.692244:0:3657:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787360358.692255:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1787360358.692263:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787360358.692268:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787360358.692271:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a05a07000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787360358.692273:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787360358.692281:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787360358.692287:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3657:1874182596167040:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787360358.708142:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360358.710795:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787360358.710805:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787360358.712526:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787360358.712538:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787360358.722912:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787360358.722929:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787360358.723816:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360358.724070:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787360358.724076:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787360358.724689:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787360358.724696:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787360358.786683:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360358.788124:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787360358.788270:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787360358.792174:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787360358.792188:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787360358.793594:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360358.793915:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787360358.793922:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787360358.795040:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787360358.795049:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787360358.796121:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360358.796769:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787360358.796776:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787360358.800492:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787360358.800506:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787360358.801620:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360358.801804:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787360358.801810:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787360358.803537:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787360358.803560:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787360358.834214:0:22748:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360358.834558:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787360358.834567:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787360358.836870:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787360358.836883:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787360358.837771:0:22748:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787360358.837779:0:22748:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787360358.839380:0:22748:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787360358.839418:0:22748:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787360358.839424:0:22748:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787360358.839531:0:22748:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787360358.839577:0:22748:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787360358.839583:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787360358.839584:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360358.839586:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360358.839587:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360358.839589:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360358.839590:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360358.839591:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360358.839593:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360358.839595:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360358.839597:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360358.839599:0:22748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787360358.839601:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360358.839602:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360358.839603:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360358.839604:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360358.839605:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360358.839606:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360358.839607:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360358.839614:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360358.839615:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360358.839616:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360358.839642:0:22748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787360358.839659:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360358.839719:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360358.839754:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.839935:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167168 00000100:00100000:2.0:1787360358.839942:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167168 00000100:00100000:2.0:1787360358.839987:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360358.839997:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:22748:x1874182596167168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360358.840047:0:22764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787360358.840049:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787360358.840053:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787360358.840577:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787360358.840939:0:22764:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787360358.842600:0:22786:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787360358.842606:0:22786:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787360358.842609:0:22786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787360358.842611:0:22786:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787360358.842828:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787360358.843016:0:22764:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787360358.843026:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787360358.845744:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:22748:x1874182596167168:12345-0@lo:253:mount.lustre.0 Request processed in 5740us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.845760:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360358.845873:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787360358.845889:0:22748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787360358.845892:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787360358.845894:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360358.845895:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360358.845897:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360358.845898:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360358.845900:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360358.845901:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360358.845903:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360358.845905:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360358.845907:0:22748:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787360358.845926:0:22748:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a05a04000 from lustre-MDT0000 10000000:01000000:3.0:1787360358.845955:0:22748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787360358.845958:0:22748:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787360358.845962:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9989034d3370 10000000:01000000:3.0:1787360358.845968:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360358.845976:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9989034d3370 from 1 10000000:01000000:3.0:1787360358.845979:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787360358.846016:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360358.846045:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360358.846055:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360358.846082:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360358.846119:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360358.846157:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.846214:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167296 00000100:00100000:2.0:1787360358.846221:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167296 00000100:00100000:2.0:1787360358.846298:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360358.846307:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:22748:x1874182596167296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.846322:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.846337:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71e00/0x359a4e2aee72191c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721915 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.846359:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71e00/0x359a4e2aee72191c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721915 expref: 6 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.846369:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71e00/0x359a4e2aee72191c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721915 expref: 6 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.846378:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:2.0:1787360358.846543:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:22748:x1874182596167296:12345-0@lo:101:mount.lustre.0 Request processed in 237us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.846559:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360358.846639:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360358.846654:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.846663:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.846736:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360358.846764:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.846792:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360358.846906:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167424 00000100:00100000:3.0:1787360358.846911:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167424 00000100:00100000:3.0:1787360358.846944:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360358.846951:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:22748:x1874182596167424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360358.847037:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:22748:x1874182596167424:12345-0@lo:501:mount.lustre.0 Request processed in 86us (271us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360358.847043:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360358.847159:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787360358.847186:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787360358.847203:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.847211:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360358.847219:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a05a04000 10000000:01000000:1.0:1787360358.847246:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787360358.847251:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998a05a04000 10000000:01000000:1.0:1787360358.847254:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787360358.847257:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998a05a04000 from 1 10000000:01000000:1.0:1787360358.847259:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787360358.847278:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.847286:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.847305:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360358.847317:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360358.847345:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360358.847362:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.847557:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167552 00000100:00100000:2.0:1787360358.847562:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167552 00000100:00100000:2.0:1787360358.847602:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360358.847609:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:22748:x1874182596167552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.847617:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.847628:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70600/0x359a4e2aee72192a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721923 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.847642:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70600/0x359a4e2aee72192a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721923 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.847651:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70600/0x359a4e2aee72192a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721923 expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.847658:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:2.0:1787360358.847694:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+7:22748:x1874182596167552:12345-0@lo:101:mount.lustre.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.847699:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360358.847966:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360358.847978:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72192a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.847987:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72192a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360358.847999:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787360358.848013:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72192a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.848020:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee721923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72192a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360358.848025:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787360358.848029:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787360358.848033:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998a05a04000 10000000:01000000:1.0:1787360358.848036:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787360358.848039:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787360358.848041:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787360358.848054:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.848066:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.848074:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360358.848086:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360358.848113:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360358.848150:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.848355:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167680 00000100:00100000:2.0:1787360358.848360:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167680 00000100:00100000:2.0:1787360358.848390:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360358.848396:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+7:22748:x1874182596167680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.848471:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.848481:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70200/0x359a4e2aee721938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721931 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.848496:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70200/0x359a4e2aee721938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721931 expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.848504:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70200/0x359a4e2aee721938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721931 expref: 8 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.848522:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70200, rc 0) 00000100:00100000:2.0:1787360358.848564:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+8:22748:x1874182596167680:12345-0@lo:101:mount.lustre.0 Request processed in 168us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.848570:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360358.848692:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360358.848703:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721938 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360358.848711:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721938 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360358.848766:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360358.848791:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360358.848892:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360358.851385:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167808 00000100:00100000:3.0:1787360358.851473:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167808 00000100:00100000:3.0:1787360358.851546:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360358.851566:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+8:22748:x1874182596167808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360358.852904:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22748:x1874182596167808:12345-0@lo:501:mount.lustre.0 Request processed in 1333us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360358.852916:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787360358.853178:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360358.853386:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360358.853611:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360358.853646:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.854359:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596167936 00000100:00100000:2.0:1787360358.854369:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596167936 00000100:00100000:2.0:1787360358.854520:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360358.854531:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22748:x1874182596167936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360358.855301:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22748:x1874182596167936:12345-0@lo:503:mount.lustre.0 Request processed in 770us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.855310:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360358.855649:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596167936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360358.856057:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22787:1874182596168064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360358.856104:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360358.857289:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27180 going to sleep for 11 seconds 00000100:00100000:3.0:1787360358.857657:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168064 00000100:00100000:3.0:1787360358.857665:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168064 00000100:00100000:3.0:1787360358.857721:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360358.857747:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22787:x1874182596168064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.860652:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22787:x1874182596168064:12345-0@lo:502:llog_process_th.0 Request processed in 2898us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.860665:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360358.860824:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22787:1874182596168064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787360358.860860:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360358.860872:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360358.860874:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787360358.860880:0:22787:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787360358.860883:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360358.860899:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff998902ba99b8) 00000020:00000080:1.0:1787360358.860919:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787360358.860925:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787360358.861032:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787360358.861041:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee721946 00000020:00000080:1.0:1787360358.862630:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787360358.862641:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360358.862648:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360358.862650:0:22787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787360358.862653:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360358.862658:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360358.862660:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787360358.862664:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360358.862677:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff998902bacd28) 00000020:00000080:1.0:1787360358.862694:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787360358.862699:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787360358.862700:0:22787:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787360358.862703:0:22787:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787360358.862709:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360358.862772:0:22787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a05a04000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787360358.862786:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff998902ba8000) 00000020:00000080:1.0:1787360358.862794:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787360358.862846:0:22787:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787360358.862866:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee72195b 00000020:00000080:1.0:1787360358.862964:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787360358.862970:0:22787:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787360358.862975:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x359a4e2aee721962 00080000:01000000:1.0:1787360358.862980:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787360358.862984:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee721969 00010000:00010000:2.0:1787360358.923306:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787360358.924375:0:22787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787360358.925089:0:22787:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787360358.925765:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9989038e19b8) 00000020:00000080:2.0:1787360358.925784:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787360358.925867:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787360358.925874:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee721977 00000020:00000080:0.0:1787360358.927310:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787360358.932738:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x359a4e2aee72197e 00000020:00000080:2.0:1787360358.933214:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787360358.933245:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360358.933252:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.933254:0:22787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787360358.933258:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787360358.933261:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787360358.933269:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360358.933271:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360358.933273:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787360358.933276:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.933277:0:22787:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787360358.933280:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360358.933286:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.933288:0:22787:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787360358.933292:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787360358.933336:0:22787:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787360358.933351:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360358.933354:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.933356:0:22787:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787360358.933359:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360358.933361:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.933363:0:22787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787360358.933365:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787360358.933371:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:2.0:1787360358.933394:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360358.933407:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9989038e4d28) 00000020:00000080:2.0:1787360358.933418:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787360358.933422:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787360358.933469:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787360358.933473:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787360358.933478:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee72198c 00010000:00080000:2.0:1787360358.933507:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c825800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787360358.935414:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787360358.936804:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360358.936819:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787360358.936854:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787360358.936874:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721993 00000100:00080000:0.0:1787360358.936885:0:22787:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360358.936890:0:22787:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a3c825800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360358.936925:0:22787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904175180 x1874182596168192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360358.937074:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360358.937141:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360358.937475:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1787360358.937541:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360358.937546:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.937558:0:22787:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787360358.937562:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360358.937565:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787360358.937567:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360358.937568:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360358.937570:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360358.937573:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.937575:0:22787:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360358.937577:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360358.937582:0:22787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787360358.937586:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.937587:0:22787:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787360358.937590:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360358.937593:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1787360358.937616:0:22787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787360358.937618:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360358.937631:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff998a34553370) 00000020:00000080:0.0:1787360358.937644:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787360358.937649:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360358.937719:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787360358.937724:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787360358.937730:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7219a1 00010000:00080000:0.0:1787360358.937756:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a0ffac000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360358.937956:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787360358.938610:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168192 00000100:00100000:1.0:1787360358.938620:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168192 00000100:00100000:1.0:1787360358.938649:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360358.938657:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596168192:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787360358.938675:0:22774:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1787360358.939115:0:22787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360358.939644:0:22787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787360358.943162:0:22787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360358.943699:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787360358.951153:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787360358.951678:0:22793:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787360358.951683:0:22793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787360358.952491:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360358.952503:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787360358.952539:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787360358.952568:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7219a8 00000100:00080000:0.0:1787360358.952579:0:22787:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360358.952584:0:22787:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998a0ffac000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360358.952617:0:22787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904175f80 x1874182596168320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360358.952683:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168320:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787360358.952744:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596168320 offset 0 length 520: 4 00000100:00080000:0.0:1787360358.952798:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787360358.952911:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360358.953094:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.953097:0:22787:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787360358.953101:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360358.953104:0:22787:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787360358.953106:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360358.953108:0:22787:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360358.953109:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360358.953112:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.953113:0:22787:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360358.953116:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360358.953120:0:22787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787360358.953124:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360358.953125:0:22787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787360358.953128:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360358.953132:0:22787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1787360358.953153:0:22787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787360358.953155:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360358.953167:0:22787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff998a34554d28) 00000020:00000080:0.0:1787360358.953179:0:22787:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787360358.953183:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360358.953264:0:22787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787360358.953270:0:22787:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787360358.953276:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7219b6 00010000:00080000:0.0:1787360358.953303:0:22787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a31370800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360358.953503:0:22787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787360358.953580:0:22787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360358.953595:0:22787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787360358.955601:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596168192:12345-0@lo:38:llog_process_th.0 Request processed in 16936us (18453us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360358.955614:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787360358.955683:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360358.955690:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360358.955694:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168192:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787360358.957135:0:22787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360358.957469:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787360358.957601:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1787360358.958111:0:22795:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787360358.958116:0:22795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787360358.958954:0:22787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360358.958968:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787360358.959005:0:22787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787360358.959028:0:22787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7219bd 00000100:00080000:2.0:1787360358.959043:0:22787:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360358.959048:0:22787:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a31370800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360358.959086:0:22787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdea00 x1874182596168448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360358.959145:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168448:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787360358.959210:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596168448 offset 0 length 520: 4 00000100:00080000:2.0:1787360358.959353:0:22787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787360358.959403:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360358.959407:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.959409:0:22787:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787360358.959412:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360358.959416:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.959417:0:22787:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787360358.959420:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787360358.959422:0:22787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787360358.959424:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360358.959426:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.959428:0:22787:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787360358.959430:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360358.959432:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.959433:0:22787:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787360358.959436:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787360358.959464:0:22787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22787:1874182596168576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.959512:0:22787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360358.959534:0:22787:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a07f9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360358.959701:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168576 00000100:00100000:0.0:1787360358.959708:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168576 00000100:00100000:0.0:1787360358.959752:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787360358.959762:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22787:x1874182596168576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360358.959897:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22787:x1874182596168576:12345-0@lo:502:llog_process_th.0 Request processed in 136us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360358.959905:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360358.960069:0:22787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22787:1874182596168576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360358.960095:0:22787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360358.960099:0:22787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360358.960100:0:22787:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787360358.960104:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787360358.960449:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787360358.960471:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787360358.960520:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721938 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.960532:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee721931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721938 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360358.960540:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a05a04000 from 1 10000000:01000000:0.0:1787360358.960543:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360358.960584:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.960599:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.960609:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.960625:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360358.960659:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.960723:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.960783:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168704 00000100:00100000:2.0:1787360358.960789:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168704 00000100:00100000:2.0:1787360358.960919:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360358.960928:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+9:22748:x1874182596168704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.960938:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.960950:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7219c4 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.960970:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.960980:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 10 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.960994:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71c00, rc 0) 00000100:00100000:2.0:1787360358.961027:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+10:22748:x1874182596168704:12345-0@lo:101:mount.lustre.0 Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.961034:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360358.961057:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360358.961070:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.961079:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.961920:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168832:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787360358.961966:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.962000:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360358.962081:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168832 00000100:00100000:1.0:1787360358.962088:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168832 00000100:00100000:1.0:1787360358.962121:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360358.962128:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+10:22748:x1874182596168832:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787360358.962145:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787360358.962150:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787360358.962463:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+10:22748:x1874182596168832:12345-0@lo:256:mount.lustre.0 Request processed in 334us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360358.962471:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360358.962490:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168832:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787360358.963984:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360358.964005:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.964016:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360358.964039:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a05a04000 from 1 10000000:01000000:0.0:1787360358.964042:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360358.964076:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.964084:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.964094:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.964113:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360358.964173:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.964381:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.964873:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596168960 00000100:00100000:2.0:1787360358.964881:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596168960 00000100:00100000:2.0:1787360358.964971:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360358.964980:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+10:22748:x1874182596168960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.964993:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.965008:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7219d2 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.965030:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 11 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.965041:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 11 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.965070:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71a00, rc 0) 00000100:00100000:2.0:1787360358.965123:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596168960:12345-0@lo:101:mount.lustre.0 Request processed in 143us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.965130:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787360358.965167:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596168960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360358.965183:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.965192:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.965491:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360358.965526:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.965608:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360358.965644:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169088 00000100:00100000:1.0:1787360358.965649:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169088 00000100:00100000:1.0:1787360358.965718:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360358.965726:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596169088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360358.965934:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596169088:12345-0@lo:501:mount.lustre.0 Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360358.965949:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787360358.966025:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360358.966055:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360358.966102:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.966123:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.966169:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169216 00000100:00100000:2.0:1787360358.966173:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169216 00000100:00100000:0.0:1787360358.966464:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787360358.966473:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596169216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360358.970367:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596169216:12345-0@lo:503:mount.lustre.0 Request processed in 3886us (4254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360358.970381:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360358.970406:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360358.971701:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22797:1874182596169344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360358.971763:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360358.971803:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360358.971821:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169344 00000100:00100000:1.0:1787360358.971890:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169344 00000100:00100000:1.0:1787360358.971967:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360358.971977:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22797:x1874182596169344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360358.972452:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22797:x1874182596169344:12345-0@lo:502:llog_process_th.0 Request processed in 475us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360358.972460:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360358.973068:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22797:1874182596169344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360358.973099:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360358.973108:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973110:0:22797:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787360358.973117:0:22797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a05a04000 00000020:00000080:3.0:1787360358.973120:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360358.973127:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360358.973129:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973131:0:22797:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787360358.973133:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360358.973135:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973137:0:22797:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787360358.973147:0:22797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a05a04000 00000020:00000080:3.0:1787360358.973149:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360358.973208:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360358.973212:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973213:0:22797:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787360358.973215:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360358.973217:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973219:0:22797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360358.973222:0:22797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a05a04000 00000020:00000080:3.0:1787360358.973246:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360358.973266:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360358.973269:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973271:0:22797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360358.973273:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360358.973275:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.973276:0:22797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787360358.973279:0:22797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a05a04000 00000020:00000080:3.0:1787360358.973281:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787360358.973828:0:22797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22797:1874182596169472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360358.973887:0:22797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360358.973932:0:22797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787360358.974339:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169472 00000100:00100000:0.0:1787360358.974346:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169472 00000100:00100000:0.0:1787360358.974394:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787360358.974404:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22797:x1874182596169472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360358.974533:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22797:x1874182596169472:12345-0@lo:502:llog_process_th.0 Request processed in 120us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360358.974541:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360358.974904:0:22797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22797:1874182596169472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360358.974934:0:22797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360358.974940:0:22797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360358.974942:0:22797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787360358.974945:0:22797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787360358.977742:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787360358.977794:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360358.977829:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.977842:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360358.977900:0:22748:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360358.977903:0:22748:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a05a04000 10000000:01000000:0.0:1787360358.977906:0:22748:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a05a04000 10000000:01000000:0.0:1787360358.977909:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360358.977915:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a05a04000 from 1 10000000:01000000:0.0:1787360358.977923:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360358.977956:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.977964:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.977974:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.977995:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360358.978054:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.978098:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.978109:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169600 00000100:00100000:2.0:1787360358.978116:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169600 00000100:00100000:2.0:1787360358.978167:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787360358.978176:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22748:x1874182596169600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360358.978189:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360358.978212:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70000/0x359a4e2aee7219e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7219e0 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.978267:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70000/0x359a4e2aee7219e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7219e0 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.978278:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70000/0x359a4e2aee7219e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7219e0 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360358.978292:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70000, rc 0) 00000100:00100000:2.0:1787360358.978329:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596169600:12345-0@lo:101:mount.lustre.0 Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.978336:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360358.978571:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360358.978586:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219e7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360358.978595:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7219e7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360358.978648:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360358.978674:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.978702:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.978760:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169728 00000100:00100000:2.0:1787360358.978765:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169728 00000100:00100000:2.0:1787360358.978798:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787360358.978805:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596169728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360358.978994:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596169728:12345-0@lo:501:mount.lustre.0 Request processed in 188us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.979001:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360358.979075:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360358.979104:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360358.979141:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360358.979162:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.979344:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169856 00000100:00100000:2.0:1787360358.979349:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169856 00000100:00100000:2.0:1787360358.979381:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360358.979387:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596169856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360358.979465:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596169856:12345-0@lo:503:mount.lustre.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.979472:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360358.980333:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596169856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360358.982596:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596169984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.982803:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360358.982853:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1849b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360358.984655:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596169984 00000100:00100000:3.0:1787360358.984665:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596169984 00000100:00100000:3.0:1787360358.984831:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787360358.984843:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596169984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360358.985006:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596169984:12345-0@lo:502:llog_process_th.0 Request processed in 165us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360358.985014:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360358.985274:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596169984:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787360358.985354:0:22800:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787360358.985369:0:22800:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9989038e3370) 00000020:00000080:2.0:1787360358.985387:0:22800:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787360358.985477:0:22800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a05a04000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787360358.985481:0:22800:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a05a04000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787360358.985484:0:22800:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a05a04000 4 00010000:00080000:2.0:1787360358.985512:0:22800:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c821000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787360358.989864:0:22800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787360358.991050:0:22800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787360358.991100:0:22800:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787360358.991117:0:22800:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x359a4e2aee7219f5 00000100:00080000:2.0:1787360358.991129:0:22800:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360358.991141:0:22800:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff998a3c821000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360358.991178:0:22800:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fdc000 x1874182596170112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360358.991209:0:22800:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787360358.991282:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596170112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360358.991350:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360358.991559:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170112 00000100:00100000:2.0:1787360358.991567:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170112 00000100:00100000:2.0:1787360358.991600:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360358.991608:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596170112:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360358.991661:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596170112:12345-0@lo:38:llog_process_th.0 Request processed in 52us (311us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787360358.991668:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360358.991905:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360358.991913:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c821000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360358.991917:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787360358.991921:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596170112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360358.994887:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596170240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.994962:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360358.995001:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.995041:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170240 00000100:00100000:2.0:1787360358.995047:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170240 00000100:00100000:2.0:1787360358.995087:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787360358.995096:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596170240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.995207:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596170240:12345-0@lo:502:llog_process_th.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.995221:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787360358.995295:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596170240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.995335:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596170368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.995365:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360358.995383:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.995394:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170368 00000100:00100000:2.0:1787360358.995397:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170368 00000100:00100000:2.0:1787360358.995417:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360358.995422:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596170368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360358.995481:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22800:x1874182596170368:12345-0@lo:502:llog_process_th.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360358.995488:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360358.995520:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22800:1874182596170368:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787360358.998796:0:22800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787360358.998961:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787360358.999000:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787360358.999022:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219e7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360358.999035:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01688600/0x359a4e2aee7219e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7219e7 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787360358.999092:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787360358.999094:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360358.999096:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360358.999097:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360358.999098:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360358.999100:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360358.999101:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360358.999103:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360358.999105:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360358.999106:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360358.999110:0:22748:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787360358.999113:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360358.999114:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360358.999115:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360358.999116:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360358.999117:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360358.999118:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360358.999119:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360358.999120:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360358.999122:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360358.999123:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360358.999143:0:22748:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787360358.999161:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596170496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360358.999257:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360358.999288:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360358.999351:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170496 00000100:00100000:2.0:1787360358.999358:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170496 00000100:00100000:2.0:1787360358.999399:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360358.999408:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596170496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360358.999433:0:22763:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787360358.999446:0:22763:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787360359.005586:0:22763:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787360359.005606:0:22763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787360359.005795:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787360359.005800:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787360359.005834:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.005852:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.005860:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.005897:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.005912:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360359.005925:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596170624:0@lo:104: 00000100:00100000:0.0:1787360359.005983:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360359.006025:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360359.006028:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170624 00000100:00100000:1.0:1787360359.006036:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170624 00000100:00100000:1.0:1787360359.006084:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360359.006095:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596170624:12345-0@lo:104: 00010000:00010000:1.0:1787360359.006108:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360359.006173:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360359.006180:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596170624:12345-0@lo:104: Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360359.006187:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360359.006259:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596170624:0@lo:104: 00010000:00010000:0.0:1787360359.006280:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007706:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360359.007716:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007735:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787360359.007739:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007748:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360359.007756:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360359.007761:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787360359.007797:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007803:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787360359.007822:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007828:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01688c00/0x359a4e2aee7219c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219cb expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360359.007844:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360359.007846:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360359.007848:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360359.008346:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596170752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360359.008403:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360359.008752:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22748:x1874182596170496:12345-0@lo:253:mount.lustre.0 Request processed in 9119us (9270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360359.008772:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360359.008852:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22748:1874182596170496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787360359.008864:0:22748:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787360359.008868:0:22748:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787360359.008869:0:22748:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787360359.008871:0:22748:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360359.008872:0:22748:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360359.008873:0:22748:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360359.008874:0:22748:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360359.008875:0:22748:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360359.008877:0:22748:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787360359.008879:0:22748:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360359.008881:0:22748:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787360359.008893:0:22748:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787360359.009101:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170752 00000100:00100000:0.0:1787360359.009108:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170752 00010000:00010000:0.0:1787360359.009132:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360359.009166:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360359.009195:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:3658:x1874182596170752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360359.009207:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360359.009212:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009238:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009255:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71c00/0x359a4e2aee7219cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7219c4 expref: 12 pid: 22764 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009268:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009275:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360359.009288:0:22754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003488619s 00010000:00010000:0.0:1787360359.009292:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009299:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009306:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009311:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009317:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360359.009325:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009333:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009346:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009354:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360359.009388:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:3658:x1874182596170752:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360359.009394:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787360359.009420:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009427:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360359.009434:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689600/0x359a4e2aee7219fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360359.011085:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596170752:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787360359.034709:0:22748:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1787360359.035422:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787360359.035429:0:22808:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1787360359.035434:0:22808:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1787360359.035919:0:22809:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787360359.036094:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1787360359.036613:0:22810:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff998a2ee5d180 x1874182596170880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360359.036624:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000040:01000000:0.0:1787360359.036986:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787360359.037022:0:22748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787360359.037563:0:22748:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787360359.037572:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787360359.037609:0:22748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360359.038588:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787360359.039259:0:22748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787360359.039288:0:22748:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787360359.040703:0:22809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360359.043803:0:22748:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787360359.045522:0:22748:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:0.0:1787360359.046396:0:22809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787360359.046454:0:22809:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:3.0:1787360359.048752:0:22748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787360359.051276:0:22748:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787360359.051312:0:22748:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4f7816ef988 00100000:10000000:3.0:1787360359.051319:0:22748:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787360359.053108:0:22748:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787360359.053128:0:22748:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787360359.053145:0:22748:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787360359.053164:0:22748:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787360359.063311:0:22748:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360359.063496:0:22748:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787360359.673746:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360360.062842:0:22805:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787360360.062852:0:22805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360360.065279:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787360360.065291:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787360360.066133:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:2.0:1787360360.701621:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787360360.701640:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787360360.701643:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a05a04000 from 11 10000000:01000000:2.0:1787360360.701648:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360360.701690:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.701702:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.701713:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360360.701746:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596171008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360360.701808:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360360.701845:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360360.701865:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171008 00000100:00100000:2.0:1787360360.701883:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171008 00000100:00100000:2.0:1787360360.701930:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360360.701939:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+11:22767:x1874182596171008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360360.701953:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360360.701965:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721a03 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.701997:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.702007:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.702016:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71400, rc 0) 00000100:00100000:2.0:1787360360.702052:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22767:x1874182596171008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360360.702059:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360360.702097:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596171008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360360.702110:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.702119:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360360.702162:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596171136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787360360.702188:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360360.702201:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360360.702214:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171136 00000100:00100000:2.0:1787360360.702217:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171136 00000100:00100000:2.0:1787360360.702454:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360360.702462:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22767:x1874182596171136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787360360.702476:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787360360.702501:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787360360.702509:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787360360.702600:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:22767:x1874182596171136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360360.702607:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360360.702634:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596171136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787360360.702670:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787360360.702677:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360360.702685:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360361.081637:0:22805:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787360361.081648:0:22805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360361.081800:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1787360361.081843:0:22805:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360361.081978:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1787360361.082074:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:0.0:1787360361.725864:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360362.106600:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:3.0:1787360362.746894:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360363.130197:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000001:02000400:2.0:1787360363.509460:0:23053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787360363.772484:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360364.154960:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000100:00080000:1.0:1787360364.281688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787360364.281696:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:0.0:1787360364.281805:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360364.281822:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596171264:0@lo:400:kworker.0 00000100:00100000:0.0:1787360364.281890:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360364.282122:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360364.282128:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:1.0:1787360364.282149:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360364.282155:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a3c825800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360364.282189:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff46680 x1874182596171392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360364.282212:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360364.282217:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360364.282219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360364.282222:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360364.282252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787360364.282255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787360364.282257:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c821000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360364.282262:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff998a3c821000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360364.282274:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff45f80 x1874182596171520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360364.282343:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171392:0@lo:38:kworker.0 00000100:00100000:0.0:1787360364.282378:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360364.282407:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596171520:0@lo:38:kworker.0 00000100:00100000:0.0:1787360364.282433:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360364.282909:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171392 00000100:00100000:1.0:1787360364.282917:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171392 00000100:00100000:1.0:1787360364.282954:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360364.282961:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596171392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787360364.282979:0:22775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360364.283101:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596171392:12345-0@lo:38:kworker.0 Request processed in 137us (721us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360364.283108:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787360364.283189:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360364.283194:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360364.283198:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171392:0@lo:38:kworker.0 00000100:00100000:2.0:1787360364.284125:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171264 00000100:00100000:2.0:1787360364.284132:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171264 00000100:00100000:2.0:1787360364.284638:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787360364.284651:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:3658:x1874182596171264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360364.285353:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:3658:x1874182596171264:12345-0@lo:400:kworker.0 Request processed in 703us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360364.285363:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787360364.285416:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171520 00000100:00100000:2.0:1787360364.285422:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171520 00000100:00100000:2.0:1787360364.285465:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360364.285470:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182596171520:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787360364.285493:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1787360364.285545:0:22771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x359a4e2aee721a11 00000004:00100000:2.0:1787360364.285559:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787360364.285686:0:22771:0:(import.c:65:import_set_state_nolock()) ffff998a2ed99800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360364.287931:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874182596171520:12345-0@lo:38:kworker.0 Request processed in 2451us (5488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360364.287944:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360364.288399:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596171264:0@lo:400:kworker.0 00010000:00080000:3.0:1787360364.288899:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998a3ff45f80 x1874182596171520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360364.288916:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787360364.288924:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787360364.288929:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787360364.288932:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c821000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360364.288939:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596171520:0@lo:38:kworker.0 00000020:00000004:3.0:1787360364.517051:0:23106:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360364.517510:0:23106:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360364.793464:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360365.178252:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000020:00000004:0.0:1787360365.390896:0:23156:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360365.391141:0:23156:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787360365.817463:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360366.203440:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:0.0:1787360366.848760:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360367.226280:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:1.0:1787360367.870747:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360368.249529:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000100:00100000:3.0:1787360368.377354:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360358/real 1787360358] req@ffff998904fdea00 x1874182596168448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360368.377387:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904fdea00 x1874182596168448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360368.377397:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360358/real 1787360358] req@ffff998904175f80 x1874182596168320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360368 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360368.377406:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904175f80 x1874182596168320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360368 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360368.377423:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360368.377510:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360368.377515:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168448:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787360368.377521:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360368.377794:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360368.377798:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787360368.377801:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360368.377806:0:14779:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:0.0:1787360368.377811:0:14779:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360368.377825:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a3c825800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360368.377846:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904177480 x1874182596171776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360368.377856:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360368.377859:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360368.377861:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360368.377864:0:14779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1787360368.377867:0:14779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360368.377870:0:14779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998a0ffac000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360368.377881:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904176a00 x1874182596171904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360368.377889:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360368.377891:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360368.377893:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360368.377895:0:14779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1787360368.377897:0:14779:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360368.377900:0:14779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a31370800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360368.377927:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904174380 x1874182596172032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360368.378042:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596172160:0@lo:400:kworker.0 00000100:00100000:2.0:1787360368.378115:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787360368.378160:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360368.378172:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596168320:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787360368.378182:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360368.378191:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596171648:0@lo:400:kworker.0 00000100:00100000:2.0:1787360368.378220:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360368.378297:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171776:0@lo:38:kworker.0 00000100:00100000:3.0:1787360368.378333:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360368.378416:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171904:0@lo:8:kworker.0 00000400:00000100:3.0:1787360368.378436:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596171904 offset 0 length 520: 4 00000100:00100000:3.0:1787360368.378452:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596172032:0@lo:8:kworker.0 00000400:00000100:3.0:1787360368.378467:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596172032 offset 0 length 520: 4 00000100:00100000:3.0:1787360368.378519:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171648 00000100:00100000:3.0:1787360368.378526:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171648 00000100:00100000:3.0:1787360368.378569:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360368.378578:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:3661:x1874182596171648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360368.378628:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:3661:x1874182596171648:12345-0@lo:400:kworker.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360368.378635:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360368.378683:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596171648:0@lo:400:kworker.0 00000100:00100000:0.0:1787360368.378687:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172160 00000100:00100000:0.0:1787360368.378692:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172160 00000100:00100000:0.0:1787360368.378723:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360368.378731:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596172160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360368.378765:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596172160:12345-0@lo:400:kworker.0 Request processed in 36us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360368.378770:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787360368.378877:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998904177100 x1874182596172160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360368.378889:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596172160:0@lo:400:kworker.0 00000100:00100000:2.0:1787360368.379091:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596171776 00000100:00100000:2.0:1787360368.379097:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596171776 00000100:00100000:2.0:1787360368.379131:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360368.379137:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596171776:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787360368.379154:0:22775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787360368.379209:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596171776:12345-0@lo:38:kworker.0 Request processed in 70us (875us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360368.379217:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787360368.379260:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360368.379266:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787360368.379271:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171776:0@lo:38:kworker.0 00010000:00010000:0.0:1787360368.892400:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360369.274304:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:1.0:1787360369.916342:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360370.297344:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:0.0:1787360370.943458:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360371.321977:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787360371.322305:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:1.0:1787360371.964561:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787360372.252556:0:23501:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787360372.252561:0:23501:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787360372.252563:0:23501:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787360372.252665:0:23501:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a2f244000 00000020:01000004:3.0:1787360372.252681:0:23501:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787360372.252703:0:23501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787360372.252716:0:23501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9989034d4d28) 00000020:00000080:3.0:1787360372.252732:0:23501:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787360372.300054:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787360372.303319:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.303825:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.304067:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.304372:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.304577:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.305083:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.305499:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.305695:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.309076:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.310462:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.312291:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.313436:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.313760:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.314351:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.314614:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.314859:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.315433:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.316271:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.316640:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.317272:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.317689:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.317937:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.318309:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.318932:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.319354:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.319696:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.320054:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.320572:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.320970:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.321282:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.321579:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787360372.321908:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.322164:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787360372.322757:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787360372.323295:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787360372.323745:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787360372.324050:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787360372.324586:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787360372.329914:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787360372.330421:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787360372.330791:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787360372.331078:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787360372.331601:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787360372.331798:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787360372.331987:0:23501:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787360372.337701:0:23501:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787360372.337925:0:23501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787360372.337937:0:23501:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787360372.337950:0:23501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721a1f 00000020:01000004:2.0:1787360372.337957:0:23501:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787360372.337980:0:23501:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787360372.337983:0:23501:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787360372.337990:0:23501:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787360372.338019:0:23501:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787360372.338023:0:23501:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000100:00100000:3.0:1787360372.346003:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000040:01000000:2.0:1787360372.348113:0:23501:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787360372.348315:0:23501:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787360372.348321:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787360372.348323:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787360372.348324:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360372.348325:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360372.348327:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360372.348328:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360372.348329:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360372.348332:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360372.348333:0:23501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360372.348338:0:23501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787360372.348340:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360372.348341:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787360372.348342:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360372.348344:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360372.348345:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360372.348346:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360372.348347:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360372.348348:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360372.348349:0:23501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360372.348380:0:23501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787360372.348405:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360372.348473:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.348592:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903856300 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.351882:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172288 00000100:00100000:0.0:1787360372.351915:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172288 00000100:00100000:1.0:1787360372.352074:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787360372.352084:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:23501:x1874182596172288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787360372.352148:0:22761:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787360372.352151:0:22761:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787360372.352159:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787360372.352774:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:23501:x1874182596172288:12345-0@lo:253:mount.lustre.0 Request processed in 690us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.352782:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360372.352872:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360372.352886:0:23501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787360372.352889:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360372.352891:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787360372.352903:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360372.352904:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360372.352905:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360372.352907:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360372.352908:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360372.352910:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360372.352912:0:23501:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360372.352933:0:23501:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a2f244000 from lustre-MDT0001 10000000:01000000:2.0:1787360372.352959:0:23501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787360372.352962:0:23501:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787360372.352968:0:23501:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9989034d3370 local copy 00010000:00010000:2.0:1787360372.352978:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.353088:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360372.353145:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.353180:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360372.353342:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172416 00000100:00100000:3.0:1787360372.353348:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172416 00000100:00100000:3.0:1787360372.353379:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360372.353388:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:23501:x1874182596172416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360372.353452:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:23501:x1874182596172416:12345-0@lo:501:mount.lustre.0 Request processed in 65us (307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360372.353460:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360372.353622:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172416:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360372.353635:0:23501:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787360372.353652:0:23501:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787360372.353658:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.353678:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.353705:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a2f244000 10000000:01000000:2.0:1787360372.353710:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360372.353715:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9989034d3370 10000000:01000000:2.0:1787360372.353717:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787360372.353721:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9989034d3370 from 1 10000000:01000000:2.0:1787360372.353724:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787360372.353745:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.353752:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.353761:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.353773:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360372.353797:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.353814:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.353869:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172544 00000100:00100000:0.0:1787360372.353874:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172544 00000100:00100000:0.0:1787360372.353908:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787360372.353915:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+12:23501:x1874182596172544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360372.353924:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360372.353937:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688000/0x359a4e2aee721a2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721a26 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.353957:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688000/0x359a4e2aee721a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721a26 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.353967:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688000/0x359a4e2aee721a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721a26 expref: 13 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.353975:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688000, rc 0) 00000100:00100000:0.0:1787360372.354011:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+13:23501:x1874182596172544:12345-0@lo:101:mount.lustre.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.354017:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360372.354381:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360372.354396:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a2d expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.354404:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721a2d expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.354432:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787360372.354453:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a2d expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.354461:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71600/0x359a4e2aee721a26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a2d expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.354469:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998a2f244000 10000000:01000000:3.0:1787360372.354538:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787360372.354543:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998a2f244000 from 1 10000000:01000000:3.0:1787360372.354545:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787360372.354562:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.354569:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.354577:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360372.354590:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360372.354632:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.354651:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360372.354822:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172672 00000100:00100000:1.0:1787360372.354828:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172672 00000100:00100000:1.0:1787360372.354861:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360372.354868:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+13:23501:x1874182596172672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360372.354877:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360372.354888:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681200/0x359a4e2aee721a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721a34 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.354903:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681200/0x359a4e2aee721a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721a34 expref: 14 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.354911:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681200/0x359a4e2aee721a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721a34 expref: 14 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.354918:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681200, rc 0) 00000100:00100000:1.0:1787360372.354956:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+14:23501:x1874182596172672:12345-0@lo:101:mount.lustre.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.354963:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360372.355066:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360372.355077:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a3b expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.355091:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721a3b expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360372.355117:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787360372.355371:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a3b expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.355380:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040200/0x359a4e2aee721a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a3b expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360372.355386:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787360372.355391:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360372.355396:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998a2f244000 10000000:01000000:3.0:1787360372.355399:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787360372.355401:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787360372.355404:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787360372.355418:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.355425:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.355433:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360372.355447:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360372.355493:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.355507:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.355586:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172800 00000100:00100000:0.0:1787360372.355591:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172800 00000100:00100000:0.0:1787360372.355627:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787360372.355638:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+14:23501:x1874182596172800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360372.355646:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360372.355659:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689800/0x359a4e2aee721a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721a42 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.355675:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689800/0x359a4e2aee721a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721a42 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.355694:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689800/0x359a4e2aee721a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721a42 expref: 15 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.355701:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689800, rc 0) 00000100:00100000:0.0:1787360372.355735:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596172800:12345-0@lo:101:mount.lustre.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.355741:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360372.356036:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360372.356051:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a49 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360372.356059:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721a49 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360372.357539:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1787360372.358269:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360372.362395:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787360372.362453:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1787360372.362472:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1787360372.362499:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1787360372.362515:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1787360372.362527:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1787360372.362542:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1787360372.362554:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1787360372.362566:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1787360372.362577:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1787360372.362589:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1787360372.362600:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1787360372.362613:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1787360372.362627:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1787360372.362639:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1787360372.362652:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1787360372.362666:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1787360372.362679:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1787360372.362692:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1787360372.362704:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1787360372.362719:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1787360372.362733:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1787360372.362747:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1787360372.362774:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1787360372.362788:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1787360372.362801:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1787360372.362813:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1787360372.362830:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1787360372.362843:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1787360372.362855:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1787360372.362868:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1787360372.362882:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1787360372.362896:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1787360372.362910:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1787360372.362924:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1787360372.362939:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1787360372.362954:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1787360372.362966:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1787360372.362980:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1787360372.362993:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1787360372.363005:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1787360372.363018:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1787360372.363031:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1787360372.363044:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1787360372.363071:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1787360372.363077:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1787360372.363437:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360372.363527:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.363632:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.363680:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596172928 00000100:00100000:0.0:1787360372.363686:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596172928 00000100:00100000:0.0:1787360372.363781:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787360372.363792:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596172928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360372.363937:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596172928:12345-0@lo:501:mount.lustre.0 Request processed in 146us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.363944:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787360372.364014:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596172928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360372.364046:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360372.364096:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.367431:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360372.367562:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173056 00000100:00100000:1.0:1787360372.367570:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173056 00000100:00100000:1.0:1787360372.367613:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787360372.367621:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360372.368411:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173056:12345-0@lo:503:mount.lustre.0 Request processed in 787us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.368419:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360372.368580:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360372.369015:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360372.369090:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360372.369161:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.369189:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360372.369264:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173184 00000100:00100000:1.0:1787360372.369270:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173184 00000100:00100000:1.0:1787360372.369298:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787360372.369306:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360372.369937:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173184:12345-0@lo:502:mount.lustre.0 Request processed in 630us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.369945:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787360372.370066:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360372.371358:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787360372.371403:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1787360372.371420:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1787360372.371436:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1787360372.371455:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1787360372.371470:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1787360372.371498:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1787360372.371516:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1787360372.371533:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1787360372.371547:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1787360372.371580:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1787360372.371597:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1787360372.371611:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1787360372.371625:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1787360372.371639:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1787360372.371651:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1787360372.371661:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1787360372.371674:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1787360372.371685:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1787360372.371697:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1787360372.371710:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1787360372.371723:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1787360372.371735:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1787360372.371749:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1787360372.371772:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1787360372.371786:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1787360372.371810:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1787360372.371824:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1787360372.371837:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1787360372.371850:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1787360372.371863:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1787360372.371877:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1787360372.371890:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1787360372.371902:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1787360372.371914:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1787360372.371928:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1787360372.371942:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1787360372.371954:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1787360372.371966:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1787360372.371978:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1787360372.371992:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1787360372.372005:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1787360372.372032:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1787360372.372047:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1787360372.372087:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360372.372187:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.372248:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360372.372349:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173312 00000100:00100000:1.0:1787360372.372357:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173312 00000100:00100000:1.0:1787360372.372398:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787360372.372407:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360372.372529:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596173312:12345-0@lo:502:mount.lustre.0 Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.372538:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360372.372987:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596173312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360372.373038:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1787360372.373049:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787360372.374030:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.374042:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.374044:0:23505:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787360372.374060:0:23505:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787360372.374063:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360372.374078:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff998902bab370) 00000020:00000080:1.0:1787360372.374096:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787360372.374197:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787360372.374386:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787360372.374394:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721a57 00000020:00000080:1.0:1787360372.374612:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787360372.374618:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360372.374622:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.374624:0:23505:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787360372.374627:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.374630:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.374631:0:23505:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787360372.374634:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360372.374642:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99890273cd28) 00000020:00000080:1.0:1787360372.374653:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787360372.374658:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787360372.374660:0:23505:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787360372.374662:0:23505:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787360372.374669:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360372.374711:0:23505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a2f244000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787360372.374724:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9989027399b8) 00000020:00000080:1.0:1787360372.374736:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787360372.374811:0:23505:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787360372.374817:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721a6c 00000020:00000080:1.0:1787360372.374908:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787360372.374915:0:23505:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787360372.374919:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x359a4e2aee721a73 00080000:01000000:1.0:1787360372.374924:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787360372.374927:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721a7a 00010000:00010000:2.0:1787360372.468206:0:23505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787360372.468875:0:23505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787360372.469173:0:23505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787360372.471627:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787360372.471642:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360372.471649:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360372.471651:0:23505:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787360372.471655:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360372.471661:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360372.471662:0:23505:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787360372.471665:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787360372.471671:0:23505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:2.0:1787360372.471697:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360372.471714:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff998a3594b370) 00000020:00000080:2.0:1787360372.471736:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787360372.471741:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787360372.471837:0:23505:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787360372.471845:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787360372.471851:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721a88 00010000:00080000:2.0:1787360372.471890:0:23505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c9c7000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787360372.475547:0:23505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787360372.478452:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360372.478486:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787360372.478531:0:23505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787360372.478555:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721a8f 00000100:00080000:3.0:1787360372.478565:0:23505:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360372.478580:0:23505:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff998a3c9c7000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360372.478616:0:23505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5ce00 x1874182596173440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360372.478651:0:23505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787360372.478703:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.478707:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478709:0:23505:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787360372.478712:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787360372.478715:0:23505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787360372.478716:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.478717:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.478719:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787360372.478721:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478722:0:23505:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787360372.478724:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360372.478729:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478730:0:23505:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787360372.478733:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787360372.478763:0:23505:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787360372.478777:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.478780:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478782:0:23505:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787360372.478784:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787360372.478786:0:23505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787360372.478787:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.478788:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.478790:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787360372.478792:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478794:0:23505:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787360372.478796:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787360372.478799:0:23505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787360372.478802:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.478809:0:23505:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787360372.478813:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787360372.478816:0:23505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1787360372.478839:0:23505:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787360372.478842:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787360372.478855:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff998a28e4cd28) 00000020:00000080:3.0:1787360372.478867:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787360372.478872:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787360372.478933:0:23505:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787360372.478940:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787360372.478946:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721a9d 00010000:00080000:3.0:1787360372.478973:0:23505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c9c2800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.111@tcp at head 00000100:00100000:2.0:1787360372.479305:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596173440:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360372.479370:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360372.479436:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787360372.479440:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787360372.479443:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360372.479447:0:14779:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1787360372.479452:0:14779:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787360372.479456:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a3c825800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360372.479494:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904fde680 x1874182596173568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360372.479510:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360372.479514:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360372.479517:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360372.479520:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360372.479562:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173440 00000100:00100000:2.0:1787360372.479569:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173440 00000100:00100000:2.0:1787360372.479601:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360372.479609:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596173440:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787360372.479630:0:22775:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1787360372.479659:0:22775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721aa4 00000004:00100000:2.0:1787360372.479671:0:22775:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787360372.479678:0:22775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787360372.479756:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360372.479766:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596173696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360372.479805:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.479838:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173696 00000100:00100000:2.0:1787360372.479842:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173696 00000100:00100000:2.0:1787360372.479871:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360372.479878:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596173696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360372.479923:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596173696:12345-0@lo:400:kworker.0 Request processed in 46us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.479930:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787360372.479961:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998904fdce00 x1874182596173696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360372.479974:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596173696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360372.479997:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596173568:0@lo:38:kworker.0 00000100:00100000:2.0:1787360372.480020:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.480045:0:22774:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787360372.480052:0:22774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:3.0:1787360372.480443:0:23505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1787360372.481682:0:23505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787360372.481962:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173568 00000100:00100000:2.0:1787360372.481971:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173568 00000100:00100000:2.0:1787360372.482078:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360372.482086:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596173568:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787360372.482174:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596173568:12345-0@lo:38:kworker.0 Request processed in 87us (2153us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787360372.482181:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360372.482214:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360372.482222:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360372.482243:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787360372.482247:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596173568:0@lo:38:kworker.0 00000040:01000000:3.0:1787360372.482595:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787360372.486007:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787360372.486553:0:22775:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360372.486654:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596173440:12345-0@lo:38:llog_process_th.0 Request processed in 7042us (7281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.486683:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360372.486815:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360372.486823:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787360372.486832:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787360372.486837:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787360372.486840:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787360372.486858:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596173440:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360372.486976:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360372.486990:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596173824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360372.487039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.487138:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596173824 00000100:00100000:3.0:1787360372.487144:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596173824 00000100:00100000:3.0:1787360372.487185:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360372.487194:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1874182596173824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360372.487221:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787360372.487290:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1874182596173824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.487296:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360372.487363:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596173824:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787360372.487650:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787360372.487789:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787360372.488144:0:23511:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787360372.488149:0:23511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787360372.491906:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360372.491921:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787360372.491968:0:23505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787360372.491989:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721aab 00000100:00080000:3.0:1787360372.492000:0:23505:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360372.492006:0:23505:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998a3c9c2800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360372.492037:0:23505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5c380 x1874182596173952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360372.492072:0:23505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787360372.492211:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596173952:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787360372.492286:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596173952 offset 0 length 520: 4 00000020:01000000:3.0:1787360372.492402:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.492407:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.492409:0:23505:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787360372.492412:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787360372.492415:0:23505:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1787360372.492417:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.492418:0:23505:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787360372.492420:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787360372.492422:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.492424:0:23505:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787360372.492426:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787360372.492430:0:23505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787360372.492434:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.492435:0:23505:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787360372.492438:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787360372.492442:0:23505:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1787360372.492464:0:23505:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787360372.492467:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1787360372.492564:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.492569:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360372.492584:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.492587:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1787360372.492629:0:23505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff998a28e499b8) 00000020:00000080:3.0:1787360372.492643:0:23505:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787360372.492656:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787360372.492721:0:23505:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787360372.492729:0:23505:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787360372.492737:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721ab9 00010000:00080000:3.0:1787360372.492796:0:23505:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998902a5b000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787360372.492989:0:23505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787360372.493063:0:23505:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787360372.493077:0:23505:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787360372.494997:0:23505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360372.495216:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787360372.495561:0:23505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1787360372.496214:0:23513:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787360372.496219:0:23513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787360372.497745:0:23505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360372.497758:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787360372.497799:0:23505:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787360372.497824:0:23505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721ac0 00000100:00080000:3.0:1787360372.497834:0:23505:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360372.497839:0:23505:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360372.497883:0:23505:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5c700 x1874182596174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360372.497953:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596174080:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787360372.498004:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596174080 offset 0 length 520: 4 00000100:00080000:3.0:1787360372.498057:0:23505:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787360372.498119:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.498255:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.498257:0:23505:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787360372.498262:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360372.498265:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.498267:0:23505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787360372.498269:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787360372.498271:0:23505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787360372.498273:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.498276:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.498277:0:23505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787360372.498287:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360372.498290:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.498291:0:23505:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787360372.498295:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787360372.498321:0:23505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360372.498325:0:23505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360372.498327:0:23505:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787360372.498330:0:23505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1787360372.498506:0:23501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787360372.498536:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787360372.498559:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a49 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.498571:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041800/0x359a4e2aee721a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721a49 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.498580:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a2f244000 from 1 10000000:01000000:2.0:1787360372.498583:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360372.498608:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.498617:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.498628:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.498643:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360372.498689:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.498714:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038566c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787360372.498889:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.498895:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360372.498897:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.498900:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360372.498921:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174208 00000100:00100000:1.0:1787360372.498927:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174208 00000100:00100000:1.0:1787360372.498973:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787360372.498982:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+15:23501:x1874182596174208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360372.498995:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360372.499008:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721ac7 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.499029:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 16 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.499039:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 16 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.499049:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681000, rc 0) 00000100:00100000:1.0:1787360372.499084:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:23501:x1874182596174208:12345-0@lo:101:mount.lustre.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.499091:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360372.499273:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360372.499288:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.499298:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.499923:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174336:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787360372.499973:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.500040:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360372.500313:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174336 00000100:00100000:3.0:1787360372.500319:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174336 00000100:00100000:3.0:1787360372.500384:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360372.500393:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:23501:x1874182596174336:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787360372.500409:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787360372.500425:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787360372.500428:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787360372.500682:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:23501:x1874182596174336:12345-0@lo:256:mount.lustre.0 Request processed in 287us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.500690:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787360372.500765:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174336:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787360372.501458:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787360372.501595:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.501607:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.501616:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a2f244000 from 1 10000000:01000000:2.0:1787360372.501619:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360372.501646:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.501654:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.501663:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.501693:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360372.501933:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.501975:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.502048:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174464 00000100:00100000:0.0:1787360372.502055:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174464 00000100:00100000:0.0:1787360372.502108:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787360372.502117:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:23501:x1874182596174464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360372.502141:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360372.502153:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721ad5 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.502173:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.502183:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.502192:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689600, rc 0) 00000100:00100000:0.0:1787360372.502244:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174464:12345-0@lo:101:mount.lustre.0 Request processed in 109us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.502250:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787360372.502674:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360372.502688:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.502697:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360372.503919:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787360372.504203:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360372.504582:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787360372.504609:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787360372.504622:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787360372.504637:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787360372.504650:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787360372.504664:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787360372.504691:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787360372.504706:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787360372.504719:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787360372.504732:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787360372.504744:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787360372.504763:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787360372.504768:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787360372.504840:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360372.504909:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.504947:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903856840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.505043:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174592 00000100:00100000:0.0:1787360372.505051:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174592 00000100:00100000:0.0:1787360372.505104:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787360372.505113:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360372.505262:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174592:12345-0@lo:501:mount.lustre.0 Request processed in 149us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.505270:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787360372.505395:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360372.505429:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360372.505490:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360372.505511:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.505665:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174720 00000100:00100000:2.0:1787360372.505669:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174720 00000100:00100000:2.0:1787360372.505705:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360372.505713:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360372.505788:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174720:12345-0@lo:503:mount.lustre.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.505795:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787360372.505914:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360372.506352:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360372.506423:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360372.506641:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360372.506672:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.506750:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174848 00000100:00100000:2.0:1787360372.506756:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174848 00000100:00100000:2.0:1787360372.506926:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787360372.506936:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360372.507039:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174848:12345-0@lo:502:mount.lustre.0 Request processed in 104us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.507047:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360372.507117:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360372.507347:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787360372.507375:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787360372.507389:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787360372.507401:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787360372.507414:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787360372.507428:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787360372.507442:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787360372.507454:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787360372.507488:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787360372.507521:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787360372.507536:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787360372.507559:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360372.507603:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360372.507904:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.507967:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596174976 00000100:00100000:0.0:1787360372.507972:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596174976 00000100:00100000:0.0:1787360372.508002:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787360372.508009:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360372.508147:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596174976:12345-0@lo:502:mount.lustre.0 Request processed in 137us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.508162:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360372.508429:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596174976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360372.508601:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787360372.508618:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787360372.509375:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.509385:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.509387:0:23515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787360372.509394:0:23515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a2f244000 00000020:00000080:1.0:1787360372.509397:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360372.509403:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360372.509406:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.509407:0:23515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787360372.509410:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.509412:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.509413:0:23515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787360372.509417:0:23515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a2f244000 00000020:00000080:1.0:1787360372.509419:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360372.509580:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360372.509586:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.509587:0:23515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787360372.509590:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.509592:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.509593:0:23515:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360372.509597:0:23515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a2f244000 00000020:00000080:1.0:1787360372.509599:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360372.510201:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360372.510207:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.510209:0:23515:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360372.510212:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360372.510215:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.510216:0:23515:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787360372.510220:0:23515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a2f244000 00000020:00000080:1.0:1787360372.510222:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360372.510402:0:23515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360372.510405:0:23515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360372.510407:0:23515:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787360372.510410:0:23515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787360372.512289:0:23501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787360372.512331:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360372.516094:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.516131:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360372.516197:0:23501:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787360372.516200:0:23501:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a2f244000 10000000:01000000:2.0:1787360372.516203:0:23501:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a2f244000 10000000:01000000:2.0:1787360372.516207:0:23501:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360372.516212:0:23501:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a2f244000 from 1 10000000:01000000:2.0:1787360372.516214:0:23501:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787360372.516262:0:23501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.516276:0:23501:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.516289:0:23501:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360372.516312:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360372.516388:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.516434:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989038563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.518040:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175104 00000100:00100000:0.0:1787360372.518051:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175104 00000100:00100000:0.0:1787360372.518110:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360372.518129:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:23501:x1874182596175104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360372.518146:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360372.518161:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688c00/0x359a4e2aee721aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721ae3 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.518188:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688c00/0x359a4e2aee721aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721ae3 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.518197:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688c00/0x359a4e2aee721aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721ae3 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.518205:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688c00, rc 0) 00000100:00100000:0.0:1787360372.518291:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175104:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.518297:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787360372.518441:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360372.518459:0:23501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721aea expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360372.518488:0:23501:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721aea expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360372.525445:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787360372.525822:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360372.526062:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787360372.526087:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787360372.526098:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787360372.526109:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787360372.526123:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787360372.526197:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787360372.526208:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787360372.526254:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787360372.526267:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787360372.526276:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787360372.526286:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787360372.526295:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787360372.526312:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787360372.526322:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787360372.526332:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787360372.526341:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787360372.526350:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787360372.526359:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787360372.526369:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787360372.526378:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787360372.526387:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787360372.526396:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787360372.526406:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787360372.526425:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787360372.526436:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787360372.526445:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787360372.526455:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787360372.526464:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787360372.526547:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787360372.526560:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787360372.526569:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787360372.526579:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787360372.526588:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787360372.526598:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787360372.526607:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787360372.526616:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787360372.526626:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787360372.526635:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787360372.526644:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787360372.526667:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787360372.526679:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787360372.526689:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787360372.526699:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787360372.526708:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787360372.526718:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787360372.526736:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787360372.526746:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787360372.526755:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787360372.526841:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787360372.526861:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787360372.526880:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787360372.526886:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787360372.526974:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360372.527046:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.527087:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360372.529633:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175232 00000100:00100000:1.0:1787360372.529646:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175232 00000100:00100000:1.0:1787360372.529710:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787360372.529720:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360372.529895:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175232:12345-0@lo:501:mount.lustre.0 Request processed in 176us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360372.529903:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360372.530037:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360372.530087:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360372.530206:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.530278:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.530345:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175360 00000100:00100000:2.0:1787360372.530350:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175360 00000100:00100000:2.0:1787360372.530381:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787360372.530388:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360372.530497:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175360:12345-0@lo:503:mount.lustre.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.530504:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360372.530693:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360372.531101:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360372.531383:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360372.531431:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.531515:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.536747:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175488 00000100:00100000:2.0:1787360372.536761:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175488 00000100:00100000:2.0:1787360372.536873:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787360372.536885:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360372.537063:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175488:12345-0@lo:502:mount.lustre.0 Request processed in 179us (5630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.537071:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787360372.537610:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360372.537857:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787360372.537890:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787360372.537906:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787360372.537920:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787360372.537936:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787360372.537951:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787360372.537966:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787360372.537992:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787360372.538009:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787360372.538023:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787360372.538038:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787360372.538050:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787360372.538062:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787360372.538075:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787360372.538105:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787360372.539215:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787360372.540654:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787360372.540679:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787360372.540693:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787360372.540707:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787360372.540719:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787360372.540731:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787360372.540745:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787360372.540761:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787360372.540778:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787360372.540793:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787360372.540807:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787360372.540820:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787360372.540834:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787360372.540848:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787360372.540880:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787360372.540895:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787360372.540908:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787360372.540922:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787360372.540936:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787360372.540949:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787360372.540962:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787360372.540975:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787360372.540989:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787360372.541002:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787360372.542287:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787360372.542305:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787360372.542320:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787360372.542334:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787360372.542348:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787360372.542361:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787360372.542390:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787360372.542404:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787360372.542456:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360372.542554:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.542608:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.542759:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175616 00000100:00100000:2.0:1787360372.542767:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175616 00000100:00100000:2.0:1787360372.542827:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787360372.542837:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360372.542960:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175616:12345-0@lo:502:mount.lustre.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.542968:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360372.543066:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360372.543429:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1787360372.543454:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1787360372.543886:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360372.543930:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.544206:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.549288:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175744 00000100:00100000:2.0:1787360372.549301:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175744 00000100:00100000:2.0:1787360372.549366:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787360372.549376:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360372.549551:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596175744:12345-0@lo:502:mount.lustre.0 Request processed in 175us (5618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.549558:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787360372.549720:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596175744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360372.549803:0:23501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1787360372.549817:0:23501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787360372.551729:0:23521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787360372.551747:0:23521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff998a28e48000) 00000020:00000080:3.0:1787360372.551771:0:23521:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787360372.551878:0:23521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a2f244000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787360372.551882:0:23521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a2f244000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787360372.551885:0:23521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a2f244000 3 00010000:00080000:3.0:1787360372.552204:0:23521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a28e29800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787360372.555201:0:23521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787360372.555435:0:23521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787360372.555494:0:23521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787360372.555509:0:23521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x359a4e2aee721af8 00000100:00080000:3.0:1787360372.555519:0:23521:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360372.555532:0:23521:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998a28e29800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360372.555566:0:23521:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5ca80 x1874182596175872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360372.555594:0:23521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787360372.555706:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.555712:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360372.555715:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360372.555718:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360372.556425:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596175872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360372.556506:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360372.556878:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596175872 00000100:00100000:3.0:1787360372.556888:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596175872 00000100:00100000:3.0:1787360372.556927:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360372.556941:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596175872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787360372.556966:0:22769:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1787360372.557012:0:22769:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x359a4e2aee721aff 00000004:00100000:3.0:1787360372.557027:0:22769:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787360372.557056:0:22769:0:(import.c:65:import_set_state_nolock()) ffff998a28e2b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360372.557112:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874182596175872:12345-0@lo:38:llog_process_th.0 Request processed in 176us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.557120:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787360372.557361:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998a2ee5ca80 x1874182596175872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360372.557373:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360372.557382:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787360372.557389:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787360372.557393:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787360372.557396:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a28e29800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360372.557402:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596175872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787360372.559346:0:23521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1787360372.559581:0:23501:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787360372.559611:0:23501:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787360372.559630:0:23501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721aea expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360372.559642:0:23501:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70c00/0x359a4e2aee721ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721aea expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787360372.559693:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787360372.559696:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787360372.559698:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360372.559699:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360372.559700:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360372.559702:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360372.559703:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787360372.559706:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360372.559707:0:23501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360372.559711:0:23501:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787360372.559713:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787360372.559719:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787360372.559720:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360372.559721:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360372.559722:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360372.559723:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360372.559724:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787360372.559725:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360372.559726:0:23501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360372.559749:0:23501:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787360372.559766:0:23501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596176000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787360372.559831:0:23501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360372.559875:0:23501:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35780 going to sleep for 11 seconds 00000100:00100000:3.0:1787360372.560618:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176000 00000100:00100000:3.0:1787360372.560632:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176000 00000100:00100000:3.0:1787360372.560683:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787360372.560693:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596176000:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360372.560723:0:22761:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787360372.560736:0:22761:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787360372.561768:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787360372.561800:0:22761:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787360372.561808:0:22761:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787360372.563378:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:23501:x1874182596176000:12345-0@lo:253:mount.lustre.0 Request processed in 2676us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.563393:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:0.0:1787360372.563505:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787360372.563510:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787360372.563530:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563546:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563564:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563572:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563607:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563620:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 17 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360372.563632:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596176128:0@lo:104: 00000100:00100000:0.0:1787360372.563667:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787360372.563711:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563720:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360372.563728:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596176256:0@lo:104: 00000100:00100000:0.0:1787360372.563751:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360372.563767:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27480 going to sleep for 11 seconds 00000100:00100000:0.0:1787360372.563787:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176128 00000100:00100000:0.0:1787360372.563794:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176128 00000100:00100000:0.0:1787360372.563823:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176256 00000100:00100000:0.0:1787360372.563826:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176256 00000100:00100000:0.0:1787360372.563839:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360372.563846:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596176128:12345-0@lo:104: 00010000:00010000:0.0:1787360372.563864:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563920:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360372.563927:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596176128:12345-0@lo:104: Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.563933:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360372.563948:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360372.563954:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596176256:12345-0@lo:104: 00010000:00010000:0.0:1787360372.563961:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.563991:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787360372.563995:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596176256:12345-0@lo:104: Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.564000:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360372.564031:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596176128:0@lo:104: 00000100:00100000:0.0:1787360372.564039:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596176256:0@lo:104: 00010000:00010000:0.0:1787360372.564057:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564070:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360372.564075:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564081:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360372.564085:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564098:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360372.564105:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360372.564111:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360372.564208:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564216:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360372.564257:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564265:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721ace expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564278:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360372.564281:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564287:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360372.564290:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564296:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360372.564301:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360372.564311:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360372.564325:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564330:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360372.564336:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564342:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721a0a expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564353:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360372.564354:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360372.564356:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360372.564367:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596176384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360372.564394:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360372.564414:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360372.564419:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596176512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360372.564438:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360372.564466:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176384 00000100:00100000:0.0:1787360372.564470:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176384 00010000:00010000:0.0:1787360372.564498:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 18 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360372.564518:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176512 00000100:00100000:0.0:1787360372.564521:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176512 00010000:00010000:0.0:1787360372.564532:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 19 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360372.564559:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360372.564566:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:3660:x1874182596176384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360372.564576:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360372.564581:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 19 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564591:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 19 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564604:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681000/0x359a4e2aee721ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721ac7 expref: 19 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564614:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360372.564641:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3660:x1874182596176384:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.564648:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360372.564660:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360372.564666:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:3660:x1874182596176512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360372.564673:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360372.564678:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564686:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564695:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71400/0x359a4e2aee721a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721a03 expref: 17 pid: 22761 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564714:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564722:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360372.564733:0:22754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003488619s 00010000:00010000:0.0:1787360372.564737:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564744:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564750:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564757:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564762:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360372.564766:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564773:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564785:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564794:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360372.564823:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:3660:x1874182596176512:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360372.564830:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360372.564862:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596176512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360372.564870:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596176384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360372.564887:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564894:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360372.564901:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689c00/0x359a4e2aee721b06 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360372.565270:0:23501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:23501:1874182596176000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787360372.565283:0:23501:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787360372.565287:0:23501:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787360372.565288:0:23501:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787360372.565290:0:23501:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360372.565291:0:23501:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360372.565292:0:23501:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360372.565294:0:23501:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360372.565295:0:23501:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787360372.565297:0:23501:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360372.565299:0:23501:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787360372.565309:0:23501:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787360372.566244:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787360372.575624:0:23501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787360372.575927:0:23527:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787360372.576327:0:23501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787360372.576644:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596176640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.576709:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.576749:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996e40 going to sleep for 11 seconds 00000040:01000000:0.0:1787360372.576909:0:23501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787360372.576950:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360372.577487:0:23527:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787360372.578494:0:23501:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787360372.578507:0:23501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787360372.578576:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360372.579291:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176640 00000100:00100000:2.0:1787360372.579302:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176640 00000100:00100000:2.0:1787360372.579355:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360372.579378:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596176640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.579500:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596176640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 124us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.579508:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360372.579558:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596176640:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787360372.579592:0:23528:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787360372.579631:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596176768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.579668:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.579693:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176768 00000100:00100000:2.0:1787360372.579697:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176768 00000100:00100000:2.0:1787360372.579717:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360372.579723:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596176768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.579809:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596176768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360372.579815:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360372.579834:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360372.579847:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596176768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.579896:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23528:1874182596176896:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.579923:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.579939:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996cc0 going to sleep for 11 seconds 00000020:00080000:3.0:1787360372.580028:0:23526:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787360372.580032:0:23526:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787360372.580058:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596176896 00000100:00100000:3.0:1787360372.580063:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596176896 00000100:00100000:3.0:1787360372.580087:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360372.580093:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1874182596176896:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787360372.580143:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1874182596176896:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.580150:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787360372.581660:0:23501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787360372.582329:0:23501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787360372.582364:0:23501:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787360372.582554:0:23501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1787360372.582804:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998904fdc380 x1874182596176896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360388 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360372.582819:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23528:1874182596176896:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.582886:0:23528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596177024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360372.582954:0:23528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360372.582989:0:23528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360372.583147:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177024 00000100:00100000:3.0:1787360372.583153:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177024 00000100:00100000:3.0:1787360372.583199:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360372.583209:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596177024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787360372.583307:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23528:x1874182596177024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360372.583314:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:1.0:1787360372.584053:0:23527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:2.0:1787360372.584423:0:23528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23528:1874182596177024:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787360372.584485:0:23528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787360372.587079:0:23501:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000004:00080000:1.0:1787360372.587309:0:23527:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787360372.591284:0:23528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787360372.591367:0:23528:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787360372.591373:0:23528:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1787360372.593018:0:23501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787360372.594517:0:23501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787360372.594553:0:23501:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4f781857988 00100000:10000000:1.0:1787360372.594560:0:23501:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787360372.595606:0:23501:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787360372.595647:0:23501:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787360372.595668:0:23501:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787360372.595682:0:23501:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787360372.600046:0:23501:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360372.600350:0:23501:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360372.988272:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360373.370256:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000040:00080000:2.0:1787360373.563093:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787360373.949017:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787360373.949024:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a2f244000 from 12 10000000:01000000:2.0:1787360373.949030:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360373.949075:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360373.949088:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360373.949099:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360373.949123:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360373.949210:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360373.949293:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360373.949462:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177152 00000100:00100000:3.0:1787360373.949477:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177152 00000100:00100000:3.0:1787360373.949536:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360373.949756:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:22767:x1874182596177152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360373.949771:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360373.949788:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b0d expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.949810:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.949821:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.949830:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040a00, rc 0) 00000100:00100000:3.0:1787360373.949881:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596177152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360373.949887:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787360373.949964:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360373.949978:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360373.949986:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360373.950048:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787360373.950082:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360373.950144:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360373.956721:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177280 00000100:00100000:0.0:1787360373.956738:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177280 00000100:00100000:0.0:1787360373.956819:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787360373.956832:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596177280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787360373.956883:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787360373.956898:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787360373.956901:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787360373.957034:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596177280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 205us (6949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360373.957042:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360373.957104:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360373.957163:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360373.957173:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.957196:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360373.957208:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787360373.957210:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a05a04000 from 12 10000000:01000000:3.0:1787360373.957218:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787360373.957312:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.957322:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.957332:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360373.957353:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360373.957393:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360373.957439:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360373.957580:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177408 00000100:00100000:0.0:1787360373.957585:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177408 00000100:00100000:0.0:1787360373.957607:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787360373.957613:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596177408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360373.957622:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360373.957635:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b1b expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360373.957735:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360373.957747:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 18 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360373.957756:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688800, rc 0) 00000100:00100000:0.0:1787360373.957791:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596177408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360373.957797:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787360373.958205:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360373.958219:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360373.958263:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360373.958310:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360373.958355:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360373.958384:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360373.958421:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177536 00000100:00100000:0.0:1787360373.958426:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177536 00000100:00100000:0.0:1787360373.958458:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787360373.958464:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596177536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787360373.958495:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787360373.958516:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787360373.958519:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787360373.958580:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596177536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360373.958586:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360373.958634:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596177536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787360373.958674:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787360373.958681:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360373.958689:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360374.009685:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360374.393379:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000040:00080000:3.0:1787360374.585983:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787360375.037355:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360375.417345:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:3.0:1787360376.058391:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360376.444906:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00010000:00010000:3.0:1787360377.094839:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787360377.107037:0:23770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787360377.467656:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 0 seconds 00000100:00080000:1.0:1787360377.593440:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787360377.593447:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787360377.593461:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360377.593474:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a3c825800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360377.593497:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3ff45180 x1874182596177792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360377.593523:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360377.593527:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360377.593530:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360377.593533:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360377.593570:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360377.593576:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360377.593576:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596177664:0@lo:400:kworker.0 00000100:00080000:1.0:1787360377.593579:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360377.593592:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360377.593661:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596178048:0@lo:400:kworker.0 00000100:00100000:3.0:1787360377.593774:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596177792:0@lo:38:kworker.0 00000100:00100000:0.0:1787360377.593841:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360377.593871:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596177920:0@lo:400:kworker.0 00000100:00100000:1.0:1787360377.595324:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360377.597011:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360377.597027:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596178176:0@lo:400:kworker.0 00000100:00100000:3.0:1787360377.597356:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178048 00000100:00100000:3.0:1787360377.597365:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178048 00000100:00100000:3.0:1787360377.597416:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360377.597425:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596178048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360377.597503:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596178048:12345-0@lo:400:kworker.0 Request processed in 78us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360377.597510:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360377.598283:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360377.598361:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596178048:0@lo:400:kworker.0 00000100:00100000:1.0:1787360377.598392:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360377.598435:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177792 00000100:00100000:1.0:1787360377.598440:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177792 00000100:00100000:1.0:1787360377.598478:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360377.598483:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596177792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787360377.598509:0:22775:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:1.0:1787360377.598545:0:22775:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721b29 00000004:00100000:1.0:1787360377.598561:0:22775:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787360377.598567:0:22775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787360377.598699:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178176 00000100:00100000:3.0:1787360377.598703:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178176 00000100:00100000:3.0:1787360377.598991:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360377.598998:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596178176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360377.599060:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596178176:12345-0@lo:400:kworker.0 Request processed in 51us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360377.599068:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787360377.599373:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3ff47480 x1874182596178176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360377.599386:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596178176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360377.600044:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177664 00000100:00100000:1.0:1787360377.600063:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177664 00000100:00100000:1.0:1787360377.600106:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360377.600114:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3658:x1874182596177664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360377.600169:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3658:x1874182596177664:12345-0@lo:400:kworker.0 Request processed in 57us (6479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360377.600175:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787360377.600306:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596178304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360377.600396:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360377.600435:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596177664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360377.600478:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178304 00000100:00100000:1.0:1787360377.600483:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178304 00000100:00100000:1.0:1787360377.600514:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360377.600521:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596178304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360377.600561:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787360377.600678:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596178304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360377.600685:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360377.600841:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596178304:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787360377.605439:0:22775:0:(import.c:65:import_set_state_nolock()) ffff9989037df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360377.605570:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596177792:12345-0@lo:38:kworker.0 Request processed in 7083us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360377.605582:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787360377.605924:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787360377.605934:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787360377.605939:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787360377.605942:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787360377.605965:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003cb250cd): req@ffff998a2ee5d180 x1874182596170880/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360377.606030:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596177792:0@lo:38:kworker.0 00000100:00100000:3.0:1787360377.606126:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360377.606158:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fb6ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360377.606185:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596170880 00000100:00100000:1.0:1787360377.606357:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360377.606370:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596178432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360377.606399:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360377.606501:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178432 00000100:00100000:3.0:1787360377.606508:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178432 00000100:00100000:0.0:1787360377.606523:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596170880 00000100:00100000:3.0:1787360377.606566:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787360377.606582:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360377.606584:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596178432:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360377.606597:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22810:x1874182596170880:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000024:3.0:1787360377.606644:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360377.606705:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596178432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360377.606739:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22810:x1874182596170880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360377.606749:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360377.606830:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360377.606875:0:22810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22810:1874182596170880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787360377.606910:0:22810:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787360377.606952:0:22810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22810:1874182596178560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787360377.606990:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360377.607023:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1787360377.607333:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596178432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360377.607353:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178560 00000100:00100000:1.0:1787360377.607358:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178560 00000100:00100000:1.0:1787360377.607388:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360377.607395:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22810:x1874182596178560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360377.607519:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22810:x1874182596178560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 124us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360377.607527:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360377.607564:0:22810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22810:1874182596178560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360377.611145:0:22810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22810:1874182596178688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360377.611327:0:22810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360377.611365:0:22810:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360377.612849:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178688 00000100:00100000:0.0:1787360377.612860:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178688 00000100:00100000:0.0:1787360377.612929:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787360377.612940:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22810:x1874182596178688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787360377.613073:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22810:x1874182596178688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360377.613080:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360377.613946:0:22810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22810:1874182596178688:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787360377.614023:0:22810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360377.614356:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360377.614428:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596177920 00000100:00100000:3.0:1787360377.614437:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596177920 00000100:00100000:3.0:1787360377.614504:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360377.614514:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596177920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360377.614590:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596177920:12345-0@lo:400:kworker.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360377.614598:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787360377.614647:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3ff44000 x1874182596177920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360377.614663:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596177920:0@lo:400:kworker.0 00000040:00080000:1.0:1787360377.623810:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787360377.623898:0:22810:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:1.0:1787360377.623904:0:22810:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787360378.107372:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787360378.167436:0:23822:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360378.167909:0:23822:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787360379.064125:0:23873:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360379.064394:0:23873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787360379.129799:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360380.125826:0:23921:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4081a3a0 20000000:00000080:1.0:1787360380.125849:0:23921:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a3cf60800 uarg=0000000000000000 20000000:01000000:1.0:1787360380.125898:0:23921:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787360380.125907:0:23921:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787360380.125912:0:23921:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787360380.126784:0:23922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787360380.127030:0:23921:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787360380.135660:0:23921:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787360380.135915:0:23921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.135938:0:23921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.135946:0:23921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.135975:0:23921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.136031:0:23921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.136045:0:23921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360380.136061:0:23921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1874182596178816:0@lo:104: 00000100:00100000:2.0:1787360380.136147:0:23921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360380.136253:0:23921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.136263:0:23921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360380.136286:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178816 00000100:00100000:0.0:1787360380.136297:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178816 00000100:00100000:0.0:1787360380.136362:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360380.136381:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:23921:x1874182596178816:12345-0@lo:104: 00010000:00010000:0.0:1787360380.136396:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136468:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360380.136474:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:23921:x1874182596178816:12345-0@lo:104: Request processed in 95us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360380.136482:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787360380.136518:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360380.136525:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136532:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360380.136537:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136545:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360380.136553:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360380.136558:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360380.136592:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136599:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360380.136622:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136638:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721ad5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721adc expref: -99 pid: 23501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136652:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360380.136654:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360380.136656:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360380.136678:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596179072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360380.136712:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360380.136770:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179072 00000100:00100000:0.0:1787360380.136774:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179072 00010000:00010000:0.0:1787360380.136793:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 18 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360380.136813:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360380.136820:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3660:x1874182596179072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360380.136831:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360380.136837:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 18 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136848:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 18 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360380.136866:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360380.136894:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3660:x1874182596179072:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360380.136900:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360380.136936:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596179072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360380.137644:0:23921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1874182596178944:0@lo:104: 00000100:00100000:2.0:1787360380.137687:0:23921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360380.137728:0:23921:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c26c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787360380.137748:0:23921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689600/0x359a4e2aee721adc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721ad5 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360380.137763:0:23921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1874182596178816:0@lo:104: 00000100:00100000:1.0:1787360380.137868:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596178944 00000100:00100000:1.0:1787360380.137876:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596178944 00000100:00100000:1.0:1787360380.137920:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360380.137929:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:23921:x1874182596178944:12345-0@lo:104: 00010000:00010000:1.0:1787360380.137943:0:22753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.137994:0:22753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360380.138000:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:23921:x1874182596178944:12345-0@lo:104: Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360380.138006:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787360380.138024:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360380.138029:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138036:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360380.138040:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138062:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360380.138070:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360380.138076:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360380.138118:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138125:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360380.138140:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138146:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee7219d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7219d9 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138162:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360380.138164:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360380.138165:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360380.138376:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596179200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360380.138412:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360380.138513:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179200 00000100:00100000:1.0:1787360380.138518:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179200 00010000:00010000:1.0:1787360380.138540:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360380.138569:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360380.138577:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:3661:x1874182596179200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360380.138588:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360380.138594:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138612:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 17 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138630:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138639:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138653:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138661:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138668:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138675:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138680:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360380.138684:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138691:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138699:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360380.138719:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360380.138748:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:3661:x1874182596179200:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360380.138755:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360380.138862:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596179200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360380.139635:0:23921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71a00/0x359a4e2aee7219d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7219d2 expref: 16 pid: 22764 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360380.139651:0:23921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23921:1874182596178944:0@lo:104: 00010000:00010000:2.0:1787360380.139683:0:23921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.139693:0:23921:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.139699:0:23921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360380.139705:0:23921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71000/0x359a4e2aee721b30 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360380.153541:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360381.177411:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360381.565089:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787360381.570280:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787360381.570291:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a2f244000 from 13 10000000:01000000:2.0:1787360381.570298:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360381.570362:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360381.570375:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360381.570388:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360381.570420:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.570526:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360381.570728:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360381.577496:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179328 00000100:00100000:1.0:1787360381.577517:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179328 00000100:00100000:1.0:1787360381.579023:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787360381.579044:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+16:22767:x1874182596179328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360381.579066:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360381.579103:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b37 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360381.579147:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360381.579160:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 17 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360381.579170:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681400, rc 0) 00000100:00100000:1.0:1787360381.579292:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (8766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360381.579301:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360381.579447:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360381.579478:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360381.579489:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360381.579580:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360381.579621:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360381.579801:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1787360381.580057:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179456 00000100:00100000:2.0:1787360381.580065:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179456 00000100:00100000:2.0:1787360381.580113:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360381.580180:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.580354:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360381.580362:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360381.580403:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.580457:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.580503:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360381.580519:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787360381.580531:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179584 00000100:00100000:2.0:1787360381.580535:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179584 00000100:00100000:2.0:1787360381.580564:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787360381.580570:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.581437:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 852us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360381.581448:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787360381.581537:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360381.583043:0:23989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360381.583463:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360381.583494:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360381.583508:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360381.583521:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360381.583534:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360381.583537:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a05a04000 from 13 10000000:01000000:3.0:1787360381.583541:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360381.583900:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360381.583910:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360381.583923:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360381.583965:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360381.584044:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360381.585272:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360381.585411:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179712 00000100:00100000:1.0:1787360381.585422:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179712 00000100:00100000:2.0:1787360381.585878:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787360381.585890:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+17:22767:x1874182596179712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360381.585910:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360381.585932:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b45 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360381.585966:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360381.585978:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 18 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360381.586007:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71200, rc 0) 00000100:00100000:2.0:1787360381.586426:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596179712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 536us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360381.586444:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787360381.587313:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360381.587344:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360381.587357:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360381.587823:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360381.587900:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360381.588010:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360381.589349:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179840 00000100:00100000:2.0:1787360381.589364:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179840 00000100:00100000:2.0:1787360381.589426:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787360381.589446:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596179840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.589753:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596179840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360381.589762:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787360381.590017:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360381.590912:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360381.591024:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360381.591072:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360381.591446:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596179968 00000100:00100000:2.0:1787360381.591456:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596179968 00000100:00100000:2.0:1787360381.591754:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787360381.591777:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596179968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360381.591939:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:22767:x1874182596179968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360381.591947:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787360381.592037:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596179968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360381.593437:0:23990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787360381.593509:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787360381.593535:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360381.593549:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360381.593562:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360382.202815:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360382.717133:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360372/real 1787360372] req@ffff998a2ee5c700 x1874182596174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360382 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360382.717184:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2ee5c700 x1874182596174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360382 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360382.717194:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360372/real 1787360372] req@ffff998a2ee5c380 x1874182596173952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360382 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360382.717207:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2ee5c380 x1874182596173952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360382 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360382.717246:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360382.717276:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360382.717280:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596174080:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787360382.717287:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360382.717292:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360382.717310:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596173952:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787360382.718310:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360382.718317:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360382.718320:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360382.718323:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360382.718355:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360382.718359:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787360382.718362:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360382.718370:0:14779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:3.0:1787360382.718376:0:14779:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787360382.718383:0:14779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998a3c9c2800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360382.718403:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5d500 x1874182596180608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360382.718420:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360382.718435:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787360382.718437:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360382.718440:0:14779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:3.0:1787360382.718442:0:14779:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787360382.718446:0:14779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360382.718458:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5e680 x1874182596180736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360382.718514:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596180096:0@lo:400:kworker.0 00000100:00100000:3.0:1787360382.718530:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596180224:0@lo:400:kworker.0 00000100:00100000:0.0:1787360382.718608:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360382.718659:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596180864:0@lo:400:kworker.0 00000100:00100000:0.0:1787360382.718697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360382.719607:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360382.719623:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596180992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360382.719668:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360382.719710:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180992 00000100:00100000:1.0:1787360382.719719:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180992 00000100:00100000:1.0:1787360382.719792:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360382.719808:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596180992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360382.719851:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787360382.719904:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596180992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360382.719923:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360382.719980:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596180992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360382.721159:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360382.721273:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596180352:0@lo:400:kworker.0 00000100:00100000:3.0:1787360382.721313:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360382.721333:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596181120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360382.721353:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360382.721372:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360382.721378:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596180480:0@lo:400:kworker.0 00000100:00100000:3.0:1787360382.721401:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360382.721498:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180224 00000100:00100000:0.0:1787360382.721511:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180224 00000100:00100000:0.0:1787360382.721553:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596181120 00000100:00100000:0.0:1787360382.721556:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596181120 00000100:00100000:0.0:1787360382.721568:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180480 00000100:00100000:0.0:1787360382.721571:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180480 00000100:00100000:0.0:1787360382.721587:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360382.721597:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596180224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360382.724089:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360382.724113:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596181120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360382.724159:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360382.724270:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596181120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360382.724278:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360382.724306:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360382.724313:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596180480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360382.724345:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596180480:12345-0@lo:400:kworker.0 Request processed in 33us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360382.724351:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360382.724398:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596180480:0@lo:400:kworker.0 00000100:00100000:1.0:1787360382.724418:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596181120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360382.724640:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596180224:12345-0@lo:400:kworker.0 Request processed in 3041us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360382.724648:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787360382.728623:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180864 00000100:00100000:2.0:1787360382.728641:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180864 00000100:00100000:2.0:1787360382.728706:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180352 00000100:00100000:2.0:1787360382.728710:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180352 00000100:00100000:2.0:1787360382.728734:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360382.728746:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596180864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360382.728873:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596180864:12345-0@lo:400:kworker.0 Request processed in 129us (10174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360382.728891:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360382.728911:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360382.728918:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596180352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360382.728964:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596180352:12345-0@lo:400:kworker.0 Request processed in 47us (7650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360382.728973:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787360382.729026:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2ee5d880 x1874182596180352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360382.729044:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596180352:0@lo:400:kworker.0 00000100:00100000:3.0:1787360382.729113:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596180096 00000100:00100000:3.0:1787360382.729126:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596180096 00000100:00100000:3.0:1787360382.729191:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787360382.729202:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3658:x1874182596180096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360382.729298:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3658:x1874182596180096:12345-0@lo:400:kworker.0 Request processed in 98us (10690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360382.729305:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787360382.729570:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596180608:0@lo:8:kworker.0 00000400:00000100:2.0:1787360382.729619:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596180608 offset 0 length 520: 4 00000100:00100000:2.0:1787360382.729654:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596180736:0@lo:8:kworker.0 00000400:00000100:2.0:1787360382.729677:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596180736 offset 0 length 520: 4 00000100:00100000:1.0:1787360382.730538:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596180096:0@lo:400:kworker.0 00010000:00080000:1.0:1787360382.730560:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2ee5c000 x1874182596180864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360382.730573:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596180864:0@lo:400:kworker.0 00000100:00100000:1.0:1787360382.731471:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596180224:0@lo:400:kworker.0 00010000:00010000:1.0:1787360383.226658:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360383.743314:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360368/real 1787360368] req@ffff998904176a00 x1874182596171904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360383.743345:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904176a00 x1874182596171904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360383.743356:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360368/real 1787360368] req@ffff998904174380 x1874182596172032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360383.743367:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904174380 x1874182596172032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360383.743392:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360383.743401:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360383.743405:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596171904:0@lo:8:kworker.0 00000100:00080000:3.0:1787360383.743410:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360383.743415:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360383.743428:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596172032:0@lo:8:kworker.0 00000100:00080000:0.0:1787360383.746708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360383.746715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360383.746719:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360383.746726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:0.0:1787360383.746731:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360383.746737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998a0ffac000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360383.746757:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904174000 x1874182596181504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360383.746771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360383.746774:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360383.746790:0:37:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360383.746794:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:0.0:1787360383.746796:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360383.746800:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a31370800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360383.746813:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904174380 x1874182596181632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360383.746834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360383.746838:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360383.746841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360383.746843:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360383.746874:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596181888:0@lo:400:kworker.0 00000100:00100000:0.0:1787360383.746940:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360383.746980:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787360383.746986:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596181248:0@lo:400:kworker.0 00000100:00100000:0.0:1787360383.747014:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360383.747040:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596182016:0@lo:400:kworker.0 00000100:00100000:0.0:1787360383.747065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360383.747097:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596181248 00000100:00100000:0.0:1787360383.747103:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596181248 00000100:00100000:0.0:1787360383.747148:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787360383.747158:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3660:x1874182596181248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360383.747205:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:3660:x1874182596181248:12345-0@lo:400:kworker.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360383.747212:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787360383.747272:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182016 00000100:00100000:0.0:1787360383.747276:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182016 00000100:00100000:0.0:1787360383.747301:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360383.747309:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360383.747339:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596182016:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360383.747345:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360383.747373:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596181248:0@lo:400:kworker.0 00010000:00080000:0.0:1787360383.747385:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998904177480 x1874182596182016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360383.747395:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596182016:0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748011:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596181376:0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748052:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360383.748081:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360383.748086:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596181760:0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748112:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360383.748140:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596181888 00000100:00100000:1.0:1787360383.748145:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596181888 00000100:00100000:1.0:1787360383.748173:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596181376 00000100:00100000:1.0:1787360383.748176:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596181376 00000100:00100000:1.0:1787360383.748189:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787360383.748195:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596181888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748255:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596181888:12345-0@lo:400:kworker.0 Request processed in 60us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360383.748261:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787360383.748274:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787360383.748280:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596181376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748309:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596181376:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360383.748315:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787360383.748336:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596181760 00000100:00100000:1.0:1787360383.748340:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596181760 00000100:00100000:1.0:1787360383.748360:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360383.748366:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596181760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748392:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596181760:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360383.748398:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360383.748439:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596181888:0@lo:400:kworker.0 00010000:00080000:1.0:1787360383.748465:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998904176a00 x1874182596181760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360383.748481:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596181760:0@lo:400:kworker.0 00000100:00100000:1.0:1787360383.748492:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596181376:0@lo:400:kworker.0 00000100:00100000:3.0:1787360383.749024:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596181504:0@lo:8:kworker.0 00000400:00000100:3.0:1787360383.749051:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596181504 offset 0 length 520: 4 00000100:00100000:3.0:1787360383.749076:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596181632:0@lo:8:kworker.0 00000400:00000100:3.0:1787360383.749092:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596181632 offset 0 length 520: 4 00000001:00100000:3.0:1787360383.765465:0:23502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787360384.250602:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360384.827528:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360385.273398:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360386.301030:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787360386.383880:0:24269:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787360386.383885:0:24269:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787360386.383887:0:24269:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787360386.383999:0:24269:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9989037da800 00000020:01000004:1.0:1787360386.384015:0:24269:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787360386.384030:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787360386.384044:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99890273b370) 00000020:00000080:1.0:1787360386.384650:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787360386.457306:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787360386.460833:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787360386.461046:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787360386.461318:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787360386.461774:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787360386.461978:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787360386.462420:0:24269:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1787360386.467803:0:24269:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787360386.467996:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787360386.468008:0:24269:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787360386.468019:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee721b5a 00000020:01000004:3.0:1787360386.468026:0:24269:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787360386.468158:0:24269:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787360386.468162:0:24269:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787360386.468169:0:24269:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787360386.468175:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787360386.468185:0:24269:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff998a28e4b370) 00000020:00000080:3.0:1787360386.468195:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787360386.469570:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360386.469732:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787360386.469737:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787360386.482894:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787360386.482908:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787360386.483978:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787360386.483987:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787360386.487218:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360386.487420:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787360386.487427:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787360386.488868:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787360386.488878:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787360386.516411:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360386.516626:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787360386.516632:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787360386.526894:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787360386.527173:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787360386.529616:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787360386.529632:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787360386.536630:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360386.536855:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787360386.536862:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787360386.539824:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787360386.539838:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787360386.599355:0:24269:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360386.599627:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787360386.599634:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787360386.607155:0:24269:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787360386.607170:0:24269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787360386.611511:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787360386.611544:0:24269:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787360386.611550:0:24269:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787360386.626991:0:24269:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787360386.627076:0:24269:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787360386.627081:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787360386.627083:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360386.627084:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360386.627085:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360386.627086:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360386.627087:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360386.627089:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360386.627091:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360386.627101:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360386.627105:0:24269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787360386.627107:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360386.627109:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360386.627110:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360386.627111:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360386.627112:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360386.627113:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360386.627114:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360386.627115:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360386.627116:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360386.627142:0:24269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787360386.627162:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360386.627281:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.627330:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.627473:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182144 00000100:00100000:3.0:1787360386.627480:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182144 00000100:00100000:3.0:1787360386.627604:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787360386.627615:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:24269:x1874182596182144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360386.627658:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787360386.627662:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787360386.627665:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787360386.628348:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:24269:x1874182596182144:12345-0@lo:253:mount.lustre.0 Request processed in 734us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.628358:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360386.628456:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360386.628468:0:24269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787360386.628470:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360386.628472:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360386.628473:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360386.628474:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360386.628476:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360386.628477:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360386.628478:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360386.628480:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360386.628481:0:24269:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360386.628498:0:24269:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9989037da800 from lustre-OST0000 10000000:01000000:2.0:1787360386.628524:0:24269:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787360386.628535:0:24269:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360386.628543:0:24269:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9989034d3370 local copy 00010000:00010000:2.0:1787360386.628566:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360386.628668:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360386.628700:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.629009:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.629106:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182272 00000100:00100000:0.0:1787360386.629114:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182272 00000100:00100000:0.0:1787360386.629147:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787360386.629155:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:24269:x1874182596182272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360386.629253:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:24269:x1874182596182272:12345-0@lo:501:mount.lustre.0 Request processed in 99us (552us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787360386.629260:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360386.629360:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182272:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360386.629376:0:24269:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787360386.629393:0:24269:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787360386.629400:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.629418:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360386.629444:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9989037da800 10000000:01000000:2.0:1787360386.629449:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360386.629454:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360386.629457:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360386.629461:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787360386.629464:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787360386.629486:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.629494:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.629513:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360386.629526:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360386.629564:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.629588:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.629694:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182400 00000100:00100000:0.0:1787360386.629704:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182400 00000100:00100000:0.0:1787360386.629725:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787360386.629731:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+18:24269:x1874182596182400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360386.629739:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360386.629751:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689600/0x359a4e2aee721b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b68 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.629771:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689600/0x359a4e2aee721b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b68 expref: 19 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.629781:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689600/0x359a4e2aee721b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b68 expref: 19 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.629789:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689600, rc 0) 00000100:00100000:0.0:1787360386.629829:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182400:12345-0@lo:101:mount.lustre.0 Request processed in 97us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.629835:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360386.630212:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360386.630254:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b6f expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.630265:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b6f expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360386.631330:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787360386.631991:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360386.641272:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787360386.641335:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787360386.641352:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787360386.641365:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787360386.641380:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787360386.641391:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787360386.641416:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787360386.641436:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787360386.641451:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1787360386.641468:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1787360386.641482:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1787360386.641494:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1787360386.641519:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1787360386.641525:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1787360386.641648:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360386.641716:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.641765:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360386.642186:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182528 00000100:00100000:1.0:1787360386.642194:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182528 00000100:00100000:1.0:1787360386.642274:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360386.642284:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360386.642443:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182528:12345-0@lo:501:mount.lustre.0 Request processed in 160us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.642450:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787360386.645343:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360386.650504:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360386.650596:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.650649:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.650742:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182656 00000100:00100000:3.0:1787360386.650750:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182656 00000100:00100000:3.0:1787360386.650811:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787360386.650821:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360386.652723:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182656:12345-0@lo:503:mount.lustre.0 Request processed in 1896us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.652738:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360386.652863:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360386.653628:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360386.653730:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360386.653797:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.653843:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.653975:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182784 00000100:00100000:3.0:1787360386.653982:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182784 00000100:00100000:3.0:1787360386.654027:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787360386.654037:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360386.654514:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182784:12345-0@lo:502:mount.lustre.0 Request processed in 476us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.654522:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787360386.655943:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360386.656201:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787360386.656252:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787360386.656268:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787360386.656280:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787360386.656291:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787360386.656302:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787360386.656314:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787360386.656326:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787360386.656353:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787360386.656365:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787360386.656377:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787360386.656388:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787360386.656429:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360386.656489:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.656533:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.656780:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596182912 00000100:00100000:3.0:1787360386.656788:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596182912 00000100:00100000:3.0:1787360386.656844:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787360386.656854:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360386.656980:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596182912:12345-0@lo:502:mount.lustre.0 Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.656988:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787360386.657136:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596182912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360386.657194:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1787360386.657206:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787360386.660067:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787360386.660079:0:24286:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787360386.660085:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.660088:0:24286:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787360386.660094:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360386.660110:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff998902738000) 00000020:00000080:1.0:1787360386.660136:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787360386.660141:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360386.661049:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9989037da800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787360386.661062:0:24286:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787360386.661070:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee721b7d 00010000:00010000:1.0:1787360386.665820:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787360386.669942:0:24286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1787360386.672065:0:24286:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787360386.675015:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787360386.675029:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360386.675036:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675038:0:24286:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787360386.675042:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787360386.675044:0:24286:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787360386.675046:0:24286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787360386.675060:0:24286:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787360386.675062:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787360386.675065:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675067:0:24286:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787360386.675069:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360386.675073:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675074:0:24286:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787360386.675077:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787360386.675078:0:24286:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787360386.675080:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360386.675082:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675084:0:24286:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787360386.675085:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360386.675087:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675089:0:24286:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787360386.675091:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787360386.675132:0:24286:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360386.675135:0:24286:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360386.675136:0:24286:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787360386.675139:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787360386.675430:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787360386.675460:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787360386.675488:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b6f expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.675499:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70400/0x359a4e2aee721b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b6f expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360386.675508:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9989037da800 from 1 10000000:01000000:2.0:1787360386.675511:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360386.675545:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.675576:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.675588:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360386.675611:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360386.675675:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.675710:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.676064:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183040 00000100:00100000:3.0:1787360386.676072:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183040 00000100:00100000:3.0:1787360386.676125:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787360386.676133:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596183040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360386.676147:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360386.676158:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b84 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.676191:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.676201:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.676209:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041c00, rc 0) 00000100:00100000:3.0:1787360386.676427:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183040:12345-0@lo:101:mount.lustre.0 Request processed in 294us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.676435:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360386.676527:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360386.676542:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360386.676624:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360386.678476:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787360386.678858:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360386.679639:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787360386.679679:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787360386.679697:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787360386.679711:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787360386.679725:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787360386.679739:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787360386.679753:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787360386.679766:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787360386.679781:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787360386.679795:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787360386.679824:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787360386.679862:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787360386.679869:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787360386.679960:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360386.680029:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.680085:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787360386.680290:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183168 00000100:00100000:1.0:1787360386.680298:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183168 00000100:00100000:1.0:1787360386.680341:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787360386.680350:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360386.680478:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183168:12345-0@lo:501:mount.lustre.0 Request processed in 128us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.680497:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787360386.686599:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360386.686659:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360386.686736:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360386.686786:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360386.688655:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183296 00000100:00100000:2.0:1787360386.688668:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183296 00000100:00100000:2.0:1787360386.688736:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360386.688747:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360386.688891:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183296:12345-0@lo:503:mount.lustre.0 Request processed in 146us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360386.688899:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787360386.689273:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183296:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360386.690667:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360386.690784:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360386.690847:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360386.690883:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360386.691016:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183424 00000100:00100000:2.0:1787360386.691024:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183424 00000100:00100000:2.0:1787360386.691080:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360386.691090:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360386.691342:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183424:12345-0@lo:502:mount.lustre.0 Request processed in 253us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360386.691350:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787360386.691459:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360386.691682:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787360386.691869:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787360386.691883:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787360386.691895:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787360386.691908:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787360386.691924:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787360386.691937:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787360386.691951:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787360386.691965:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787360386.691979:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787360386.691992:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787360386.692017:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.692218:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.692385:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.692513:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183552 00000100:00100000:3.0:1787360386.692520:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183552 00000100:00100000:3.0:1787360386.692654:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787360386.692663:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360386.692790:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183552:12345-0@lo:502:mount.lustre.0 Request processed in 126us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.692807:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787360386.692874:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360386.692929:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787360386.692940:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787360386.693936:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360386.693946:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.693954:0:24290:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787360386.693962:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9989037da800 00000020:00000080:0.0:1787360386.693965:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360386.693973:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360386.693976:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.693977:0:24290:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787360386.693980:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360386.693982:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.693983:0:24290:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787360386.693987:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9989037da800 00000020:00000080:0.0:1787360386.693988:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360386.694365:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360386.694371:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.694372:0:24290:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787360386.694375:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360386.694378:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.694379:0:24290:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360386.694383:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9989037da800 00000020:00000080:0.0:1787360386.694385:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360386.694434:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360386.694438:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.694439:0:24290:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360386.694442:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360386.694444:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.694445:0:24290:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787360386.694449:0:24290:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9989037da800 00000020:00000080:0.0:1787360386.694451:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360386.694476:0:24290:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360386.694479:0:24290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360386.694481:0:24290:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787360386.694483:0:24290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787360386.696488:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787360386.696534:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360386.696572:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696586:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360386.696643:0:24269:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787360386.696646:0:24269:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9989037da800 10000000:01000000:3.0:1787360386.696649:0:24269:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9989037da800 10000000:01000000:3.0:1787360386.696653:0:24269:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360386.696658:0:24269:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9989037da800 from 1 10000000:01000000:3.0:1787360386.696661:0:24269:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787360386.696696:0:24269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696704:0:24269:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696715:0:24269:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360386.696740:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360386.696803:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360386.696848:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183680 00000100:00100000:3.0:1787360386.696855:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183680 00000100:00100000:3.0:1787360386.696895:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360386.696912:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:24269:x1874182596183680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360386.696925:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360386.696936:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041600/0x359a4e2aee721b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721b92 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696956:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041600/0x359a4e2aee721b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721b92 expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696966:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041600/0x359a4e2aee721b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b92 expref: 21 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.696974:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041600, rc 0) 00000100:00100000:3.0:1787360386.697003:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596183680:12345-0@lo:101:mount.lustre.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360386.697009:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360386.697063:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360386.697083:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360386.697103:0:24269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b99 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360386.697112:0:24269:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721b99 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360386.708603:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787360386.708924:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360386.709694:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787360386.709730:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787360386.709747:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787360386.709762:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787360386.709776:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787360386.709791:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787360386.709804:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787360386.709818:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787360386.709832:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787360386.709846:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787360386.709859:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787360386.709871:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787360386.709886:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787360386.709899:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787360386.709915:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787360386.709928:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787360386.709940:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787360386.709954:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787360386.709967:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787360386.709996:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787360386.710012:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787360386.710025:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787360386.710038:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787360386.710650:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787360386.710676:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787360386.710691:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787360386.710705:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787360386.710718:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787360386.710743:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787360386.710759:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787360386.710772:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787360386.710786:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787360386.710801:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787360386.710815:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787360386.710827:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787360386.710857:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787360386.710873:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787360386.710888:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787360386.710902:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787360386.710917:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787360386.710931:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787360386.710945:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787360386.710957:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787360386.710969:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787360386.710982:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787360386.710993:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787360386.711004:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787360386.711015:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787360386.711280:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787360386.711300:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787360386.711326:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787360386.711332:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787360386.711440:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360386.711505:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.712254:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902a9fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.718328:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183808 00000100:00100000:0.0:1787360386.718344:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183808 00000100:00100000:0.0:1787360386.718423:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787360386.718442:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596183808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360386.719314:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596183808:12345-0@lo:501:mount.lustre.0 Request processed in 869us (7802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.719326:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787360386.719686:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360386.719739:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360386.719788:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360386.719826:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.720191:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596183936 00000100:00100000:0.0:1787360386.720198:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596183936 00000100:00100000:0.0:1787360386.720281:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787360386.720291:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596183936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360386.720398:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596183936:12345-0@lo:503:mount.lustre.0 Request processed in 108us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.720417:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787360386.720792:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596183936:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787360386.722967:0:24269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787360386.723200:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.723298:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.723338:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.723365:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184064 00000100:00100000:0.0:1787360386.723371:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184064 00000100:00100000:0.0:1787360386.723423:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360386.723433:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.723541:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184064:12345-0@lo:502:mount.lustre.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.724645:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360386.724742:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360386.724964:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787360386.724995:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787360386.725009:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787360386.725033:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787360386.725046:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787360386.725075:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787360386.725090:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787360386.726360:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787360386.726377:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787360386.726390:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787360386.726416:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787360386.726433:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787360386.726445:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787360386.726457:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787360386.726469:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787360386.726480:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787360386.726493:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787360386.726504:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787360386.726515:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787360386.726526:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787360386.726571:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787360386.726588:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787360386.726601:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787360386.726616:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787360386.726629:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787360386.726644:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787360386.726658:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787360386.726673:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787360386.726687:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787360386.726701:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787360386.726716:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787360386.726729:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787360386.726744:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787360386.726758:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787360386.726771:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787360386.726785:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787360386.726819:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787360386.726836:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787360386.726850:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787360386.726864:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787360386.726878:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787360386.726892:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787360386.726904:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787360386.726918:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787360386.726931:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787360386.726944:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787360386.726958:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787360386.726974:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787360386.727028:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.728304:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.728357:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.729312:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184192 00000100:00100000:0.0:1787360386.729323:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184192 00000100:00100000:0.0:1787360386.729375:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360386.729385:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.730309:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184192:12345-0@lo:502:mount.lustre.0 Request processed in 922us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.730321:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360386.730391:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360386.731222:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787360386.731289:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787360386.731325:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360386.731383:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.731436:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558000 going to sleep for 11 seconds 00000100:00100000:1.0:1787360386.731556:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184320 00000100:00100000:1.0:1787360386.731564:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184320 00000100:00100000:1.0:1787360386.731602:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787360386.731610:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360386.731727:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596184320:12345-0@lo:502:mount.lustre.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.731735:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787360386.731794:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596184320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360386.731842:0:24269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787360386.731851:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787360386.733530:0:24295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787360386.733619:0:24295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff998a345519b8) 00000020:00000080:0.0:1787360386.733644:0:24295:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787360386.733725:0:24295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9989037da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360386.733730:0:24295:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9989037da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360386.733733:0:24295:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9989037da800 3 00010000:00080000:0.0:1787360386.733771:0:24295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a4033b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360386.737307:0:24295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787360386.741031:0:24295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787360386.741207:0:24295:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360386.741221:0:24295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x359a4e2aee721ba7 00000100:00080000:0.0:1787360386.741258:0:24295:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360386.741264:0:24295:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998a4033b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360386.741297:0:24295:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890394aa00 x1874182596184448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360386.741319:0:24295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360386.741373:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.741376:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.741379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.741382:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.741433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.741437:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.741440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.741442:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360386.741474:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596184960:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.741538:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360386.741652:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596184448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787360386.743953:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596184576:0@lo:400:kworker.0 00000100:00100000:3.0:1787360386.745632:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.746679:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360386.746696:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596184832:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.746749:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.746800:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184960 00000100:00100000:0.0:1787360386.746808:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184960 00000100:00100000:0.0:1787360386.746849:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184448 00000100:00100000:0.0:1787360386.746853:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184448 00000100:00100000:0.0:1787360386.746867:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360386.746876:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596184960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.746935:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596184960:12345-0@lo:400:kworker.0 Request processed in 60us (5398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.746943:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360386.746960:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360386.746964:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596184448:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360386.746987:0:22770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1787360386.747021:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x359a4e2aee721bae 00000004:00100000:0.0:1787360386.747036:0:22770:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360386.747667:0:22770:0:(import.c:65:import_set_state_nolock()) ffff998a28e2a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360386.747725:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874182596184448:12345-0@lo:38:llog_process_th.0 Request processed in 758us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.747733:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787360386.747780:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394a680 x1874182596184960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360386.747794:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596184960:0@lo:400:kworker.0 00010000:00080000:3.0:1787360386.748765:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394aa00 x1874182596184448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360386.748777:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360386.748793:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787360386.748802:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787360386.748807:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787360386.748809:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a4033b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360386.748816:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596184448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787360386.749313:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596184704:0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.749367:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.751645:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184704 00000100:00100000:0.0:1787360386.751664:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184704 00000100:00100000:0.0:1787360386.751708:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787360386.751717:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596184704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.751843:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596184704:12345-0@lo:400:kworker.0 Request processed in 127us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.751850:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000004:0.0:1787360386.751966:0:24295:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787360386.751982:0:24295:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff998a34550000) 00000020:00000080:0.0:1787360386.752005:0:24295:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787360386.752216:0:24295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9989037da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360386.752222:0:24295:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9989037da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360386.752243:0:24295:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9989037da800 3 00010000:00080000:0.0:1787360386.752274:0:24295:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a4033f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.111@tcp at head 00000100:00100000:1.0:1787360386.753255:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184832 00000100:00100000:1.0:1787360386.753265:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184832 00000100:00100000:1.0:1787360386.753309:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787360386.753319:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596184832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.753397:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596184832:12345-0@lo:400:kworker.0 Request processed in 79us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.753416:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787360386.753482:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596184832:0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.753521:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.753565:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596184576 00000100:00100000:1.0:1787360386.753569:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596184576 00000100:00100000:1.0:1787360386.753587:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787360386.753592:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596184576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.753620:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596184576:12345-0@lo:400:kworker.0 Request processed in 28us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.753625:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787360386.753658:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596184576:0@lo:400:kworker.0 00010000:00010000:0.0:1787360386.759199:0:24295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787360386.759478:0:24295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787360386.759521:0:24295:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00010000:00080000:2.0:1787360386.759677:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394b800 x1874182596184704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360386.759702:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596184704:0@lo:400:kworker.0 00000020:00000080:0.0:1787360386.759822:0:24295:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x359a4e2aee721bbc 00000100:00080000:0.0:1787360386.759831:0:24295:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360386.759836:0:24295:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998a4033f800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360386.759865:0:24295:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890394a680 x1874182596185088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360386.759927:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596185088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360386.759997:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360386.760189:0:24295:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787360386.760263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.760266:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.760269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.760271:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.760289:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.760300:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360386.760302:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360386.760304:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360386.760334:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596185344:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.760367:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.760385:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596185856:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.760436:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.765702:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787360386.765722:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596185216:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.765786:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.765818:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596185728:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.765844:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.768703:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185088 00000100:00100000:1.0:1787360386.768716:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185088 00000100:00100000:1.0:1787360386.768783:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185856 00000100:00100000:1.0:1787360386.768786:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185856 00000100:00100000:1.0:1787360386.768826:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360386.768837:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596185856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.768924:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596185856:12345-0@lo:400:kworker.0 Request processed in 89us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.768932:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360386.768950:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360386.768954:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596185088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787360386.768992:0:22770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1787360386.769027:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x359a4e2aee721bc3 00000004:00100000:1.0:1787360386.769040:0:22770:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787360386.769255:0:22770:0:(import.c:65:import_set_state_nolock()) ffff998a3c2b9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360386.769305:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874182596185088:12345-0@lo:38:llog_process_th.0 Request processed in 348us (9307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.769312:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360386.769337:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596185472:0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.769383:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185344 00000100:00100000:1.0:1787360386.769388:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185344 00000100:00100000:1.0:1787360386.769430:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787360386.769437:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596185344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.769473:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596185344:12345-0@lo:400:kworker.0 Request processed in 37us (9106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.769490:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787360386.769539:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394a680 x1874182596185088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360386.769564:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787360386.769572:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787360386.769580:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787360386.769585:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787360386.769587:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a4033f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787360386.769593:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596185088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787360386.769627:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596185600:0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.769657:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.769693:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185600 00000100:00100000:1.0:1787360386.769697:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185600 00000100:00100000:1.0:1787360386.769719:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787360386.769726:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596185600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.769759:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596185600:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.769766:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787360386.769793:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596185600:0@lo:400:kworker.0 00000100:00080000:2.0:1787360386.769953:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360386.770123:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596185344:0@lo:400:kworker.0 00010000:00080000:0.0:1787360386.770138:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394b480 x1874182596185856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360386.770147:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596185856:0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.770172:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185216 00000100:00100000:0.0:1787360386.770177:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185216 00000100:00100000:0.0:1787360386.770205:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360386.770212:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3659:x1874182596185216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360386.770275:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3659:x1874182596185216:12345-0@lo:400:kworker.0 Request processed in 63us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.770281:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360386.770324:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596185216:0@lo:400:kworker.0 00000100:00100000:2.0:1787360386.770487:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.770591:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185728 00000100:00100000:1.0:1787360386.770595:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185728 00000100:00100000:1.0:1787360386.770627:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185472 00000100:00100000:1.0:1787360386.770632:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185472 00000100:00100000:1.0:1787360386.770646:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360386.770653:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596185728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.770704:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596185728:12345-0@lo:400:kworker.0 Request processed in 50us (4858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.770711:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360386.770724:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360386.770730:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596185472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360386.770761:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596185472:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360386.770766:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787360386.770805:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998903949880 x1874182596185472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360386.770814:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596185472:0@lo:400:kworker.0 00010000:00080000:1.0:1787360386.770924:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890394bb80 x1874182596185728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360386.770935:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596185728:0@lo:400:kworker.0 00000040:00080000:1.0:1787360386.771256:0:24295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787360386.771372:0:24269:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787360386.771412:0:24269:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787360386.771426:0:24269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b99 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360386.771437:0:24269:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040000/0x359a4e2aee721b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721b99 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787360386.771487:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787360386.771489:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787360386.771490:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360386.771495:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360386.771496:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360386.771497:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360386.771499:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360386.771501:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360386.771502:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360386.771506:0:24269:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787360386.771508:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787360386.771509:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787360386.771510:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360386.771511:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360386.771512:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360386.771513:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360386.771514:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360386.771515:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360386.771516:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360386.771537:0:24269:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787360386.771688:0:24269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596185984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787360386.771737:0:24269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360386.771853:0:24269:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902a9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360386.773359:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596185984 00000100:00100000:2.0:1787360386.773370:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596185984 00000100:00100000:2.0:1787360386.773477:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787360386.773487:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:24269:x1874182596185984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360386.773517:0:22763:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787360386.773530:0:22763:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787360386.781679:0:22763:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787360386.781700:0:22763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787360386.782117:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787360386.782122:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787360386.782142:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782158:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782165:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782173:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782210:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782222:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 21 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.782252:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596186112:0@lo:104: 00000100:00100000:0.0:1787360386.782289:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787360386.782331:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782339:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 21 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.782347:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596186240:0@lo:104: 00000100:00100000:0.0:1787360386.782384:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.782413:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10fe5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360386.782436:0:22752:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787360386.782451:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186112 00000100:00100000:0.0:1787360386.782457:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186112 00000100:00100000:0.0:1787360386.782486:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186240 00000100:00100000:0.0:1787360386.782489:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186240 00000100:00100000:0.0:1787360386.782501:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360386.782509:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596186112:12345-0@lo:104: 00010000:00010000:0.0:1787360386.782521:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782578:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360386.782584:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596186112:12345-0@lo:104: Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.782591:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360386.782607:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360386.782612:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a183e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596186240:12345-0@lo:104: 00010000:00010000:0.0:1787360386.782619:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782651:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787360386.782656:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a183e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596186240:12345-0@lo:104: Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.782661:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787360386.782696:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360386.782701:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782719:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360386.782722:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782730:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360386.782736:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360386.782742:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360386.782769:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782775:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360386.782801:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782808:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35041000/0x359a4e2aee721b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b22 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782820:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360386.782823:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782827:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360386.782830:0:22757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782845:0:22757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360386.782851:0:22757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360386.782855:0:22757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360386.782869:0:22757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782875:0:22757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360386.782881:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782887:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b70e00/0x359a4e2aee721b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b14 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.782898:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360386.782900:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360386.782902:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360386.782908:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360386.782925:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596186496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360386.782953:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.782975:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360386.782981:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596186368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360386.783005:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360386.783033:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186496 00000100:00100000:0.0:1787360386.783037:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186496 00010000:00010000:0.0:1787360386.783059:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 22 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.783079:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186368 00000100:00100000:0.0:1787360386.783082:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186368 00010000:00010000:0.0:1787360386.783092:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 23 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.783103:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360386.783110:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:3661:x1874182596186496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360386.783119:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360386.783124:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 23 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783133:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 23 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783147:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360386.783175:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:3661:x1874182596186496:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.783181:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360386.783194:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360386.783200:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a05d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:3661:x1874182596186368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360386.783207:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360386.783211:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 22 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783220:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 22 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783272:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783280:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360386.783292:0:22754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003488619s 00010000:00010000:0.0:1787360386.783295:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783302:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783309:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783316:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783321:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360386.783325:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783332:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783339:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783347:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360386.783370:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a05d1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:3661:x1874182596186368:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360386.783381:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360386.783452:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596186368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360386.783461:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596186496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360386.783489:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688800/0x359a4e2aee721b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721b1b expref: 21 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.783499:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596186112:0@lo:104: 00010000:00010000:0.0:1787360386.783507:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040a00/0x359a4e2aee721b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721b0d expref: 20 pid: 22764 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360386.783516:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596186240:0@lo:104: 00010000:00010000:0.0:1787360386.783527:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783535:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783541:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360386.783547:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689000/0x359a4e2aee721bca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360386.784679:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:24269:x1874182596185984:12345-0@lo:253:mount.lustre.0 Request processed in 11188us (12936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360386.784691:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787360386.785193:0:24269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:24269:1874182596185984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787360386.785209:0:24269:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787360386.785213:0:24269:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787360386.785215:0:24269:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787360386.785216:0:24269:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360386.785218:0:24269:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360386.785219:0:24269:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360386.785220:0:24269:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360386.785222:0:24269:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360386.785392:0:24269:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360386.785394:0:24269:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787360386.785422:0:24269:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1787360386.787488:0:24269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787360386.790515:0:24269:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787360386.790525:0:24269:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787360386.790676:0:24269:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787360386.790725:0:24269:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787360386.790745:0:24269:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787360386.790764:0:24269:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787360386.793766:0:24269:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360386.794019:0:24269:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360387.324614:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787360387.629677:0:24349:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360387.630009:0:24349:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787360387.834008:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596186624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360387.834080:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360387.834132:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186624 00000100:00100000:1.0:1787360387.834139:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186624 00000100:00100000:1.0:1787360387.834179:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360387.834187:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596186624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360387.834220:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360387.834275:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596186624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360387.834281:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360387.834320:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596186624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360387.834714:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360387.834738:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596186752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360387.834822:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360387.834891:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186752 00000100:00100000:3.0:1787360387.834900:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186752 00000100:00100000:3.0:1787360387.834951:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360387.834959:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596186752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360387.834992:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787360387.835040:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596186752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360387.835048:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360387.835384:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596186752:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360388.346804:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787360388.539606:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360388.539615:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a2f244000 from 13 10000000:01000000:0.0:1787360388.539628:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360388.539682:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360388.539700:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360388.539713:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360388.539738:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596186880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360388.539807:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360388.539850:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360388.540682:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596186880 00000100:00100000:1.0:1787360388.540693:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596186880 00000100:00100000:1.0:1787360388.540762:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787360388.540773:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+19:22767:x1874182596186880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360388.540789:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360388.540807:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721bd1 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360388.540844:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360388.540854:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 20 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360388.540863:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681c00, rc 0) 00000100:00100000:1.0:1787360388.540956:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:22767:x1874182596186880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360388.540964:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360388.540993:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596186880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360388.541012:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541024:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360388.541082:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360388.541131:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360388.541170:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360388.541220:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187008 00000100:00100000:0.0:1787360388.541251:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187008 00000100:00100000:0.0:1787360388.541295:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787360388.541304:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:22767:x1874182596187008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787360388.541319:0:22761:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787360388.541335:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787360388.541338:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787360388.541435:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:22767:x1874182596187008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360388.541443:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787360388.541582:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360388.541643:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360388.541651:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541659:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360388.541669:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787360388.541671:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a05a04000 from 13 10000000:01000000:3.0:1787360388.541674:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787360388.541692:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541699:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541707:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360388.541721:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360388.541747:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360388.541773:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360388.541788:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187136 00000100:00100000:3.0:1787360388.541791:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187136 00000100:00100000:3.0:1787360388.541819:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787360388.541826:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:22767:x1874182596187136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360388.541840:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360388.541848:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721bdf expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541862:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541871:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541878:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041200, rc 0) 00000100:00100000:3.0:1787360388.541908:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:22767:x1874182596187136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360388.541915:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787360388.541944:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360388.541955:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.541962:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360388.541998:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360388.542029:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360388.542044:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360388.542055:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187264 00000100:00100000:3.0:1787360388.542059:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187264 00000100:00100000:3.0:1787360388.542076:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787360388.542084:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:22767:x1874182596187264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787360388.542103:0:22764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787360388.542115:0:22764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787360388.542118:0:22764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787360388.542186:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:22767:x1874182596187264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360388.542193:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787360388.542251:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596187264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360388.542431:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360388.542439:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360388.542446:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360389.375808:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360390.396197:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360391.417595:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360391.809041:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787360391.930754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360391.930762:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360391.930765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360391.930768:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360391.930791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360391.930794:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360391.930804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360391.930806:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360391.930862:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596187520:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.930929:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.930977:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596188032:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931008:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931034:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787360391.931041:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596187392:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931197:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931258:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596187904:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931283:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931311:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596187648:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931334:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931353:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596188160:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931433:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931449:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360391.931454:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596187776:0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931477:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360391.931507:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187520 00000100:00100000:2.0:1787360391.931513:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187520 00000100:00100000:2.0:1787360391.931549:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187776 00000100:00100000:2.0:1787360391.931552:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187776 00000100:00100000:2.0:1787360391.931567:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360391.931576:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596187520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931631:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596187520:12345-0@lo:400:kworker.0 Request processed in 56us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360391.931647:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360391.931665:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360391.931671:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596187776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931705:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596187776:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360391.931710:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360391.931728:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188032 00000100:00100000:2.0:1787360391.931731:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188032 00000100:00100000:2.0:1787360391.931757:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187904 00000100:00100000:2.0:1787360391.931760:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187904 00000100:00100000:2.0:1787360391.931768:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187648 00000100:00100000:2.0:1787360391.931770:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187648 00000100:00100000:2.0:1787360391.931778:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188160 00000100:00100000:2.0:1787360391.931780:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188160 00000100:00100000:2.0:1787360391.931792:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787360391.931797:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596188032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360391.931824:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596188032:12345-0@lo:400:kworker.0 Request processed in 27us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360391.931945:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596187392 00000100:00100000:3.0:1787360391.931950:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596187392 00000100:00100000:3.0:1787360391.931979:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787360391.931986:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3661:x1874182596187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360391.932023:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3661:x1874182596187392:12345-0@lo:400:kworker.0 Request processed in 37us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360391.932029:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787360391.932314:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360391.932318:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360391.932350:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596187776:0@lo:400:kworker.0 00000100:00100000:0.0:1787360391.932394:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596187392:0@lo:400:kworker.0 00000100:00100000:0.0:1787360391.932407:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596187520:0@lo:400:kworker.0 00010000:00080000:0.0:1787360391.932430:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a037a6680 x1874182596188032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360391.932440:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596188032:0@lo:400:kworker.0 00000100:00100000:3.0:1787360391.932511:0:22770:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787360391.932519:0:22770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787360391.932544:0:22769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787360391.933165:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360391.939348:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360391.939388:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596187904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360391.939511:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596187904:12345-0@lo:400:kworker.0 Request processed in 149us (8226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360391.939521:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360391.939554:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360391.939562:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596187648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360391.939598:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596187648:12345-0@lo:400:kworker.0 Request processed in 37us (8263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360391.939603:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360391.939615:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360391.939623:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596188160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360391.939652:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596188160:12345-0@lo:400:kworker.0 Request processed in 31us (8278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360391.939658:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787360391.939782:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998904fdea00 x1874182596187904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360391.939799:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596187904:0@lo:400:kworker.0 00010000:00080000:0.0:1787360391.939846:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998904fdfb80 x1874182596187648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360391.939857:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596187648:0@lo:400:kworker.0 00010000:00080000:0.0:1787360391.939874:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a037a4000 x1874182596188160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360391.939883:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596188160:0@lo:400:kworker.0 00010000:00010000:2.0:1787360392.442917:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787360392.632559:0:24640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787360392.953979:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596188288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360392.954052:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360392.954116:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188288 00000100:00100000:0.0:1787360392.954124:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188288 00000100:00100000:0.0:1787360392.954304:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787360392.954316:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596188288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360392.954352:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787360392.954411:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596188288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360392.955006:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596188416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360392.955046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360392.955149:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188416 00000100:00100000:2.0:1787360392.955155:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188416 00000100:00100000:2.0:1787360392.955219:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787360392.955258:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596188416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360392.955280:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360392.955338:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360392.955621:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596188416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 394us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360392.955639:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360392.955739:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596188416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360392.957494:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596188288:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360393.465456:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787360393.634581:0:24693:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360393.634871:0:24693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787360394.044151:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1787360394.463497:0:24743:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360394.463834:0:24743:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360394.490010:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360395.513429:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360396.540993:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360397.049868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360397.049876:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360397.049879:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360397.049882:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360397.049900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360397.049904:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360397.049907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360397.049910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360397.049958:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596188928:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050023:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050076:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787360397.050083:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596188544:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050123:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050145:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596189056:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050169:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050196:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596188800:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050220:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050253:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596189312:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050286:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050306:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787360397.050311:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596188672:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050358:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596189184:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050384:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360397.050418:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188928 00000100:00100000:1.0:1787360397.050425:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188928 00000100:00100000:1.0:1787360397.050469:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188672 00000100:00100000:1.0:1787360397.050472:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188672 00000100:00100000:1.0:1787360397.050489:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360397.050497:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596188928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050554:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596188928:12345-0@lo:400:kworker.0 Request processed in 57us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050561:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360397.050578:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787360397.050585:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596188672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050617:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596188672:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050623:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787360397.050643:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188544 00000100:00100000:1.0:1787360397.050647:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188544 00000100:00100000:1.0:1787360397.050684:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787360397.050691:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3660:x1874182596188544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050720:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3660:x1874182596188544:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050736:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787360397.050764:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189056 00000100:00100000:1.0:1787360397.050769:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189056 00000100:00100000:2.0:1787360397.050771:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596188800 00000100:00100000:2.0:1787360397.050775:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596188800 00000100:00100000:1.0:1787360397.050785:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189312 00000100:00100000:1.0:1787360397.050787:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189312 00000100:00100000:2.0:1787360397.050789:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189184 00000100:00100000:2.0:1787360397.050791:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189184 00000100:00100000:1.0:1787360397.050809:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787360397.050816:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596189056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050844:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596189056:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050851:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787360397.050862:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360397.050867:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596188800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050892:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596188800:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050897:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360397.050909:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360397.050914:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.050937:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596189312:12345-0@lo:400:kworker.0 Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360397.050943:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360397.050988:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596188672:0@lo:400:kworker.0 00010000:00080000:1.0:1787360397.051001:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3ff44e00 x1874182596188800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360397.051011:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596188800:0@lo:400:kworker.0 00010000:00080000:1.0:1787360397.051021:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902916a00 x1874182596189312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360397.051036:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596189312:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.051066:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596188544:0@lo:400:kworker.0 00010000:00080000:1.0:1787360397.051076:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3ff44000 x1874182596189056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360397.051084:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596189056:0@lo:400:kworker.0 00000100:00100000:1.0:1787360397.051093:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596188928:0@lo:400:kworker.0 00000100:00100000:2.0:1787360397.053018:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360397.053035:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596189184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360397.053128:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596189184:12345-0@lo:400:kworker.0 Request processed in 99us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360397.053135:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787360397.054777:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360397.054786:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787360397.054852:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914a80 x1874182596189184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360397.054868:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596189184:0@lo:400:kworker.0 00010000:00010000:3.0:1787360397.566520:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360398.010303:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360382/real 1787360382] req@ffff998a2ee5d500 x1874182596180608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360398.010334:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2ee5d500 x1874182596180608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360398.010358:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360382/real 1787360382] req@ffff998a2ee5e680 x1874182596180736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360398.010371:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2ee5e680 x1874182596180736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787360398.010391:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360398.010416:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787360398.010427:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596180608:0@lo:8:kworker.0 00000100:00080000:1.0:1787360398.010433:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360398.010439:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787360398.010442:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596180736:0@lo:8:kworker.0 00000100:00080000:3.0:1787360398.010552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360398.010557:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360398.010560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360398.010562:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360398.010584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360398.010587:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787360398.010590:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360398.010595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787360398.010600:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787360398.010606:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998a3c9c2800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360398.010623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5e680 x1874182596189952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360398.010637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360398.010640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787360398.010642:0:8:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360398.010645:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787360398.010648:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787360398.010651:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360398.010661:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2ee5d500 x1874182596190080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360398.010700:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596189568:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.010757:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.010789:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596190336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.010839:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.010862:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787360398.010867:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596189440:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.010906:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.010931:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596190208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.010954:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.010979:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596189824:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011000:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.011018:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787360398.011023:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596189696:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.011060:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596190464:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011085:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.011111:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189568 00000100:00100000:3.0:1787360398.011118:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189568 00000100:00100000:3.0:1787360398.011168:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189824 00000100:00100000:3.0:1787360398.011172:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189824 00000100:00100000:2.0:1787360398.011185:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190336 00000100:00100000:3.0:1787360398.011188:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787360398.011188:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190336 00000100:00100000:3.0:1787360398.011196:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596189568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360398.011207:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190208 00000100:00100000:2.0:1787360398.011210:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190208 00000100:00100000:2.0:1787360398.011218:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189696 00000100:00100000:2.0:1787360398.011220:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189696 00000100:00100000:2.0:1787360398.011259:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190464 00000100:00100000:2.0:1787360398.011262:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190464 00000100:00100000:3.0:1787360398.011267:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596189568:12345-0@lo:400:kworker.0 Request processed in 71us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.011274:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787360398.011275:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787360398.011281:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596190336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011289:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787360398.011294:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596189824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360398.011317:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596190336:12345-0@lo:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.011318:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596189824:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360398.011324:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787360398.011331:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787360398.011336:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360398.011342:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596190208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011361:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360398.011368:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596189696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360398.011382:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596190208:12345-0@lo:400:kworker.0 Request processed in 41us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360398.011388:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787360398.011391:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596189696:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.011396:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360398.011405:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360398.011410:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596190464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360398.011438:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596190464:12345-0@lo:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.011829:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189440 00000100:00100000:3.0:1787360398.011834:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189440 00000100:00100000:3.0:1787360398.011877:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787360398.011884:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3661:x1874182596189440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.011918:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3661:x1874182596189440:12345-0@lo:400:kworker.0 Request processed in 35us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.011925:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1787360398.011976:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5d880 x1874182596189696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360398.011987:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596189696:0@lo:400:kworker.0 00010000:00080000:3.0:1787360398.011997:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2edb8380 x1874182596190464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360398.012005:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596190464:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.012013:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596189824:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.012037:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596189952:0@lo:8:kworker.0 00000100:00100000:3.0:1787360398.012069:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.012099:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596190080:0@lo:8:kworker.0 00000100:00100000:2.0:1787360398.012154:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787360398.012285:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596189440:0@lo:400:kworker.0 00010000:00080000:0.0:1787360398.012299:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5d180 x1874182596190208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360398.012308:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596190208:0@lo:400:kworker.0 00000100:00100000:0.0:1787360398.012319:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596189568:0@lo:400:kworker.0 00010000:00080000:0.0:1787360398.012330:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2edb9f80 x1874182596190336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360398.012337:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596190336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360398.012412:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360398.020207:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596189952 00000100:00100000:0.0:1787360398.020236:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596189952 00000100:00100000:0.0:1787360398.020276:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190080 00000100:00100000:0.0:1787360398.020279:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190080 00000100:00100000:0.0:1787360398.020294:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360398.020303:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596189952:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787360398.020335:0:24275:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:0.0:1787360398.020373:0:24275:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721bed 00002000:00100000:0.0:1787360398.020387:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff998a29314800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787360398.020391:0:24275:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787360398.020394:0:24275:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787360398.020702:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787360398.020727:0:24275:0:(import.c:65:import_set_state_nolock()) ffff998a29310000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360398.020817:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596189952:12345-0@lo:8:kworker.0 Request processed in 513us (8746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360398.020824:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360398.020841:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360398.020859:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596190080:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787360398.020871:0:24275:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787360398.020896:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596190080:12345-0@lo:8:kworker.0 Request processed in 37us (8485us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360398.020902:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787360398.020989:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5e680 x1874182596189952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360398.021002:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360398.021009:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787360398.021016:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787360398.021021:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787360398.021023:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787360398.021046:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787360398.021052:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596189952:0@lo:8:kworker.0 00000100:00080000:2.0:1787360398.021063:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360398.021067:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360398.021070:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596190080:0@lo:8:kworker.0 00000004:00080000:0.0:1787360398.021218:0:23512:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787360398.021267:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190720:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787360398.021302:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360398.021322:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b98f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360398.021333:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360398.021341:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596190592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360398.021378:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360398.021402:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190720 00000100:00100000:0.0:1787360398.021407:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190720 00000100:00100000:0.0:1787360398.021438:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360398.021444:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1874182596190720:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787360398.021628:0:23511:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787360398.021692:0:23511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676268465836ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787360398.021698:0:23511:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787360398.021732:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190592 00000100:00100000:3.0:1787360398.021736:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190592 00000100:00100000:3.0:1787360398.021757:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360398.021763:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596190592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360398.021779:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787360398.021814:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596190592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.021820:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787360398.022572:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787360398.022603:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890394b100 x1874182596190592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360398.022620:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596190592:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787360398.040925:0:23502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787360398.041151:0:24275:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787360398.041158:0:24275:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787360398.041277:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1874182596190720:12345-0@lo:7:osp-pre-0-1.0 Request processed in 19828us (19970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360398.041291:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787360398.041619:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890394b480 x1874182596190720/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787360414 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360398.041635:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190720:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787360398.041653:0:23512:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787360398.041755:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190848:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787360398.041853:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360398.041886:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360398.042019:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190848 00000100:00100000:1.0:1787360398.042027:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190848 00000100:00100000:1.0:1787360398.042156:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360398.042166:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23512:x1874182596190848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787360398.042194:0:24276:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787360398.042259:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23512:x1874182596190848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 93us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360398.042266:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787360398.042376:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914a80 x1874182596190848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360414 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360398.042388:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190848:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787360398.042398:0:23512:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787360398.042426:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190976:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787360398.042469:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360398.042483:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360398.042654:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596190976 00000100:00100000:1.0:1787360398.042659:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596190976 00000100:00100000:1.0:1787360398.042695:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360398.042702:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23512:x1874182596190976:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787360398.042728:0:24275:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1787360398.073425:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596191104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360398.073495:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.073544:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191104 00000100:00100000:3.0:1787360398.073551:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191104 00000100:00100000:3.0:1787360398.073604:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360398.073614:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596191104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360398.073646:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360398.073690:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596191104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.073697:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360398.073737:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596191104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360398.078632:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360398.078653:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596191232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360398.078717:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360398.078769:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191232 00000100:00100000:3.0:1787360398.078776:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191232 00000100:00100000:3.0:1787360398.078819:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360398.078844:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596191232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360398.078880:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787360398.078925:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596191232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.078932:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360398.080675:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596191232:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1787360398.096948:0:24270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1787360398.096967:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787360398.097259:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23512:x1874182596190976:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54551us (54783us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787360398.097280:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787360398.097437:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a037a4700 x1874182596190976/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360414 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360398.097451:0:23512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787360398.097458:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23512:1874182596190976:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787360398.097475:0:23512:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1787360398.097532:0:23512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23512:1874182596191360:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787360398.097565:0:23512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360398.097592:0:23512:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360398.097936:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191360 00000100:00100000:3.0:1787360398.097944:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191360 00000100:00100000:3.0:1787360398.097997:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360398.098007:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1874182596191360:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787360398.098069:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1874182596191360:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360398.098076:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787360398.098604:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a037a4700 x1874182596191360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360414 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360398.098617:0:23512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23512:1874182596191360:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787360398.586375:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360399.617068:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360400.633624:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360401.020309:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787360401.460450:0:25088:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787360401.460454:0:25088:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787360401.460456:0:25088:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787360401.460598:0:25088:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a3c2bf800 00000020:01000004:1.0:1787360401.460614:0:25088:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787360401.460646:0:25088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787360401.460666:0:25088:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff998a35058000) 00000020:00000080:1.0:1787360401.460686:0:25088:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787360401.537658:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787360401.543182:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787360401.543810:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787360401.544015:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787360401.544378:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787360401.544561:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787360401.545986:0:25088:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787360401.547649:0:25088:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787360401.547880:0:25088:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787360401.547898:0:25088:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787360401.547910:0:25088:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee721bfb 00000020:01000004:1.0:1787360401.547917:0:25088:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787360401.547940:0:25088:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787360401.547943:0:25088:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787360401.547949:0:25088:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787360401.548146:0:25088:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787360401.548151:0:25088:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787360401.577150:0:25088:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787360401.577205:0:25088:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787360401.577210:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787360401.577212:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787360401.577213:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360401.577214:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360401.577215:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360401.577217:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360401.577218:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360401.577220:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360401.577222:0:25088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360401.577256:0:25088:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787360401.577265:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360401.577266:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787360401.577267:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360401.577268:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360401.577269:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360401.577270:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360401.577271:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360401.577272:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360401.577273:0:25088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360401.577300:0:25088:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787360401.577319:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191488:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360401.577398:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.577441:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.577511:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191488 00000100:00100000:0.0:1787360401.577519:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191488 00000100:00100000:0.0:1787360401.577570:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787360401.577580:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:25088:x1874182596191488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787360401.577614:0:22764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787360401.577617:0:22764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787360401.577621:0:22764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787360401.577944:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:25088:x1874182596191488:12345-0@lo:253:mount.lustre.0 Request processed in 364us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.577952:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787360401.578091:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360401.578108:0:25088:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787360401.578111:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360401.578112:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787360401.578114:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360401.578115:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360401.578116:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360401.578117:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360401.578118:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360401.578120:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360401.578121:0:25088:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360401.578147:0:25088:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a3c2bf800 from lustre-OST0001 10000000:01000000:2.0:1787360401.578176:0:25088:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787360401.578179:0:25088:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787360401.578188:0:25088:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9989034d3370 local copy 00010000:00010000:2.0:1787360401.578198:0:25088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360401.578319:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360401.578359:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360401.578379:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.578993:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191616 00000100:00100000:0.0:1787360401.578999:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191616 00000100:00100000:0.0:1787360401.579049:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787360401.579057:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:25088:x1874182596191616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360401.579140:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:25088:x1874182596191616:12345-0@lo:501:mount.lustre.0 Request processed in 84us (780us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787360401.579146:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787360401.579360:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191616:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360401.579376:0:25088:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787360401.579394:0:25088:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787360401.579401:0:25088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.579410:0:25088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee721915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72191c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360401.579435:0:25088:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a3c2bf800 10000000:01000000:2.0:1787360401.579438:0:25088:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360401.579443:0:25088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787360401.579446:0:25088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360401.579449:0:25088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787360401.579452:0:25088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787360401.579472:0:25088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.579480:0:25088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.579498:0:25088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360401.579512:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360401.579539:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360401.579565:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.579627:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191744 00000100:00100000:3.0:1787360401.579632:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191744 00000100:00100000:3.0:1787360401.579664:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787360401.579671:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:25088:x1874182596191744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360401.579680:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360401.579693:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041400/0x359a4e2aee721c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721c02 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.579714:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041400/0x359a4e2aee721c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721c02 expref: 22 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.579724:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041400/0x359a4e2aee721c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c02 expref: 22 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.579732:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041400, rc 0) 00000100:00100000:3.0:1787360401.579767:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596191744:12345-0@lo:101:mount.lustre.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.579773:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787360401.579868:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360401.579879:0:25088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c09 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.579889:0:25088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721c09 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360401.584144:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787360401.588312:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360401.592557:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787360401.592610:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787360401.592622:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787360401.592633:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787360401.592646:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787360401.592658:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787360401.592669:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787360401.592679:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787360401.592692:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1787360401.592716:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1787360401.592727:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1787360401.592828:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360401.592884:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.592929:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ed02600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.593088:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596191872 00000100:00100000:3.0:1787360401.593101:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596191872 00000100:00100000:3.0:1787360401.593153:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787360401.593162:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596191872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360401.593341:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596191872:12345-0@lo:501:mount.lustre.0 Request processed in 179us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.593349:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787360401.593434:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596191872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360401.593467:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360401.593507:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.593535:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ed02600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360401.593597:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192000 00000100:00100000:1.0:1787360401.593602:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192000 00000100:00100000:1.0:1787360401.593634:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360401.593641:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360401.594470:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192000:12345-0@lo:503:mount.lustre.0 Request processed in 826us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.594478:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787360401.594683:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787360401.595059:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787360401.595134:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.595179:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.595354:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ed02600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360401.595880:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192128 00000100:00100000:2.0:1787360401.595886:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192128 00000100:00100000:2.0:1787360401.595978:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787360401.595987:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360401.596570:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192128:12345-0@lo:502:mount.lustre.0 Request processed in 582us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360401.596579:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787360401.596661:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360401.596894:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787360401.596924:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787360401.596937:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787360401.596949:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787360401.596962:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787360401.596991:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787360401.597005:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787360401.597015:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787360401.597025:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787360401.597055:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.597093:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.599026:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ed02600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.599466:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192256 00000100:00100000:3.0:1787360401.599476:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192256 00000100:00100000:3.0:1787360401.599528:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787360401.599539:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360401.599686:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192256:12345-0@lo:502:mount.lustre.0 Request processed in 149us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.599694:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787360401.599813:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787360401.599895:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787360401.599909:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787360401.600693:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360401.600702:0:25092:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787360401.600709:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.600711:0:25092:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787360401.600717:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360401.600730:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff998a3dcbb370) 00000020:00000080:0.0:1787360401.600755:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787360401.600762:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787360401.600843:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3c2bf800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787360401.600852:0:25092:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787360401.600859:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee721c17 00010000:00010000:0.0:1787360401.604901:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787360401.605752:0:25092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1787360401.607664:0:25092:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787360401.608788:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787360401.608800:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360401.608806:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.608808:0:25092:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787360401.608811:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360401.608814:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.608816:0:25092:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787360401.608818:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787360401.608820:0:25092:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787360401.608823:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360401.608825:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.608827:0:25092:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787360401.608829:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360401.608831:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.608832:0:25092:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787360401.608841:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787360401.608865:0:25092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360401.608867:0:25092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360401.608868:0:25092:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787360401.608871:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1787360401.612500:0:25088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787360401.612545:0:25088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787360401.612560:0:25088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c09 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.612586:0:25088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee721c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c09 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360401.612595:0:25088:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3c2bf800 from 1 10000000:01000000:2.0:1787360401.612598:0:25088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360401.612632:0:25088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.612640:0:25088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360401.612651:0:25088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360401.612674:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360401.612733:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360401.612806:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a6bc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.613669:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192384 00000100:00100000:0.0:1787360401.613679:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192384 00000100:00100000:0.0:1787360401.613760:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360401.613771:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:25088:x1874182596192384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360401.613786:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360401.613802:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721c1e expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.613825:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.613835:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.613844:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689400, rc 0) 00000100:00100000:0.0:1787360401.613907:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192384:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.613914:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787360401.616075:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360401.616109:0:25088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.616122:0:25088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360401.617202:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787360401.617526:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360401.617731:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787360401.617757:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787360401.617772:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787360401.617786:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787360401.617801:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787360401.617814:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787360401.617828:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787360401.617843:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787360401.617857:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787360401.617871:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787360401.617886:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787360401.617904:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787360401.617910:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787360401.618071:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360401.618140:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.618438:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360401.618501:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192512 00000100:00100000:2.0:1787360401.618508:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192512 00000100:00100000:3.0:1787360401.618653:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787360401.618664:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360401.618786:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192512:12345-0@lo:501:mount.lustre.0 Request processed in 123us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.618793:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787360401.618855:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360401.618887:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360401.618929:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.619004:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.619061:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192640 00000100:00100000:0.0:1787360401.619066:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192640 00000100:00100000:0.0:1787360401.619089:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787360401.619096:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192640:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360401.619189:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192640:12345-0@lo:503:mount.lustre.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.619206:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787360401.619629:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360401.620029:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360401.620095:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360401.620141:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.620173:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.620401:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192768 00000100:00100000:0.0:1787360401.620406:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192768 00000100:00100000:0.0:1787360401.620432:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787360401.620439:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.620527:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192768:12345-0@lo:502:mount.lustre.0 Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.620534:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787360401.620607:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360401.620763:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787360401.620801:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787360401.620814:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787360401.620825:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787360401.620835:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787360401.620845:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787360401.620854:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787360401.620863:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787360401.620874:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787360401.620885:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787360401.620897:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787360401.620919:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360401.621037:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.621066:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.621113:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596192896 00000100:00100000:0.0:1787360401.621118:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596192896 00000100:00100000:0.0:1787360401.621138:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360401.621144:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.621256:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596192896:12345-0@lo:502:mount.lustre.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.621263:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787360401.621375:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596192896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360401.621417:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787360401.621426:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787360401.622077:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360401.622085:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622087:0:25096:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787360401.622092:0:25096:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3c2bf800 00000020:00000080:1.0:1787360401.622095:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360401.622101:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360401.622110:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622111:0:25096:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787360401.622114:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360401.622116:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622117:0:25096:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787360401.622120:0:25096:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3c2bf800 00000020:00000080:1.0:1787360401.622122:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360401.622174:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360401.622177:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622178:0:25096:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787360401.622180:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360401.622183:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622184:0:25096:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360401.622195:0:25096:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3c2bf800 00000020:00000080:1.0:1787360401.622197:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360401.622211:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360401.622214:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622215:0:25096:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360401.622217:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360401.622219:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622221:0:25096:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787360401.622408:0:25096:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3c2bf800 00000020:00000080:1.0:1787360401.622411:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360401.622435:0:25096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360401.622437:0:25096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360401.622438:0:25096:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787360401.622441:0:25096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787360401.627183:0:25088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787360401.627244:0:25088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360401.627264:0:25088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627276:0:25088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360401.627347:0:25088:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360401.627351:0:25088:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a3c2bf800 10000000:01000000:0.0:1787360401.627353:0:25088:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a3c2bf800 10000000:01000000:0.0:1787360401.627358:0:25088:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360401.627370:0:25088:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a3c2bf800 from 1 10000000:01000000:0.0:1787360401.627372:0:25088:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360401.627405:0:25088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627414:0:25088:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627424:0:25088:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360401.627447:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360401.627508:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.627552:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193024 00000100:00100000:0.0:1787360401.627558:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193024 00000100:00100000:0.0:1787360401.627598:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360401.627607:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:25088:x1874182596193024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360401.627620:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360401.627630:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688800/0x359a4e2aee721c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721c2c expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627652:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688800/0x359a4e2aee721c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721c2c expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627661:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688800/0x359a4e2aee721c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c2c expref: 24 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627670:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688800, rc 0) 00000100:00100000:0.0:1787360401.627700:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193024:12345-0@lo:101:mount.lustre.0 Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.627715:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360401.627753:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.627770:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360401.627783:0:25088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c33 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360401.627791:0:25088:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721c33 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360401.633266:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787360401.633578:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360401.633744:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787360401.633769:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787360401.633785:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787360401.633799:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787360401.633813:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787360401.633826:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787360401.633841:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787360401.633854:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787360401.633882:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787360401.633897:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787360401.633909:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787360401.633923:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787360401.633936:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787360401.633948:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787360401.633962:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787360401.637108:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787360401.637155:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787360401.637168:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787360401.637180:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787360401.637191:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787360401.637202:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787360401.637222:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787360401.637261:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787360401.637275:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787360401.637288:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787360401.637299:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787360401.637311:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787360401.637321:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787360401.637345:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787360401.637358:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787360401.637368:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787360401.637379:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787360401.637403:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787360401.637415:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787360401.637426:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787360401.637437:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787360401.637447:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787360401.637458:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787360401.637469:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787360401.637479:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787360401.637490:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787360401.637500:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787360401.637511:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787360401.637522:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787360401.637535:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787360401.637547:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787360401.637559:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787360401.637572:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787360401.637750:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787360401.637769:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787360401.637783:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787360401.637788:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787360401.637883:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360401.637949:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.638002:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360401.639147:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193152 00000100:00100000:2.0:1787360401.639157:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193152 00000100:00100000:2.0:1787360401.639203:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787360401.639212:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360401.639381:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193152:12345-0@lo:501:mount.lustre.0 Request processed in 169us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360401.639389:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787360401.641244:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360401.641302:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360401.641381:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.641423:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.642092:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193280 00000100:00100000:3.0:1787360401.642100:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193280 00000100:00100000:3.0:1787360401.643684:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787360401.643702:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360401.643856:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193280:12345-0@lo:503:mount.lustre.0 Request processed in 159us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.643865:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787360401.643990:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360401.644451:0:25088:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360401.644528:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360401.644575:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.647180:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.647219:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193408 00000100:00100000:0.0:1787360401.647247:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193408 00000100:00100000:0.0:1787360401.647293:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787360401.647302:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.647465:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193408:12345-0@lo:502:mount.lustre.0 Request processed in 164us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.647474:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787360401.647683:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360401.647883:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787360401.647913:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787360401.647924:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787360401.647935:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787360401.647945:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787360401.647957:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787360401.647968:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787360401.647995:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787360401.648006:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787360401.648016:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787360401.648026:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787360401.648056:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787360401.648072:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787360401.648086:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787360401.648099:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787360401.648123:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787360401.648137:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787360401.648149:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787360401.648163:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787360401.648176:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787360401.648190:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787360401.648203:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787360401.648217:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787360401.648254:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787360401.648269:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787360401.648283:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787360401.648297:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787360401.648342:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787360401.648359:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787360401.648372:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787360401.648385:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787360401.648399:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787360401.648412:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787360401.648432:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787360401.648445:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787360401.648456:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787360401.648467:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787360401.648478:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787360401.648488:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787360401.648499:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787360401.648510:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787360401.648520:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787360401.648534:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787360401.648562:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787360401.648577:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787360401.648589:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787360401.648603:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787360401.648616:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787360401.648667:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360401.648723:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.648744:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360401.649178:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193536 00000100:00100000:0.0:1787360401.649185:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193536 00000100:00100000:0.0:1787360401.649253:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787360401.649263:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360401.649378:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193536:12345-0@lo:502:mount.lustre.0 Request processed in 116us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.649385:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787360401.650102:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360401.650312:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787360401.650349:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787360401.650379:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360401.650428:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360401.650465:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a6bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.650536:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193664 00000100:00100000:3.0:1787360401.650548:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193664 00000100:00100000:3.0:1787360401.650594:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787360401.650602:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360401.650686:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596193664:12345-0@lo:502:mount.lustre.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.650694:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787360401.650968:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596193664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360401.651070:0:25088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787360401.651078:0:25088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787360401.659446:0:25101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787360401.659463:0:25101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff998a3dcb8000) 00000020:00000080:0.0:1787360401.659487:0:25101:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787360401.659570:0:25101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3c2bf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787360401.659574:0:25101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3c2bf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787360401.659577:0:25101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3c2bf800 3 00010000:00080000:0.0:1787360401.659606:0:25101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998903737000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360401.661624:0:25101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787360401.661837:0:25101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787360401.661881:0:25101:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360401.661893:0:25101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x359a4e2aee721c41 00000100:00080000:0.0:1787360401.661902:0:25101:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360401.661908:0:25101:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff998903737000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360401.661940:0:25101:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890394b480 x1874182596193792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360401.661998:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596193792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360401.662082:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360401.662137:0:25101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787360401.662654:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193792 00000100:00100000:3.0:1787360401.662662:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193792 00000100:00100000:3.0:1787360401.662698:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360401.662706:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182596193792:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787360401.662732:0:22771:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:3.0:1787360401.662763:0:22771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x359a4e2aee721c48 00000004:00100000:3.0:1787360401.662776:0:22771:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787360401.662806:0:22771:0:(import.c:65:import_set_state_nolock()) ffff998a30850800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360401.662863:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874182596193792:12345-0@lo:38:llog_process_th.0 Request processed in 157us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.662871:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787360401.662918:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360401.662922:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360401.662925:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360401.662928:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360401.662967:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360401.662970:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787360401.662973:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360401.662977:0:14779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1787360401.662986:0:14779:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787360401.662991:0:14779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360401.663006:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edbb800 x1874182596194432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360401.663052:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596193920:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663397:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663432:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596194560:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663457:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663478:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787360401.663484:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596194048:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663506:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663524:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596194688:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663543:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663569:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596194304:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663592:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663610:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787360401.663615:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596194176:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663636:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663652:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596194816:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663689:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.663741:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194560 00000100:00100000:3.0:1787360401.663747:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194560 00000100:00100000:3.0:1787360401.663771:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194048 00000100:00100000:3.0:1787360401.663774:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194048 00000100:00100000:3.0:1787360401.663785:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194688 00000100:00100000:3.0:1787360401.663788:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194688 00000100:00100000:3.0:1787360401.663819:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194816 00000100:00100000:3.0:1787360401.663822:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194816 00000100:00100000:3.0:1787360401.663839:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360401.663846:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596194560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663889:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596194560:12345-0@lo:400:kworker.0 Request processed in 43us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.663896:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360401.663909:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360401.663915:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596194048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.663942:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596194048:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.663948:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360401.663960:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360401.663966:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596194688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360401.664068:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596193920 00000100:00100000:1.0:1787360401.664073:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596193920 00000100:00100000:1.0:1787360401.664096:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194176 00000100:00100000:1.0:1787360401.664099:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194176 00000100:00100000:1.0:1787360401.664111:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787360401.664117:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596193920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360401.664154:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596193920:12345-0@lo:400:kworker.0 Request processed in 36us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.664160:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787360401.664173:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787360401.664180:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596194176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360401.664207:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596194176:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.664213:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787360401.664279:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360401.664283:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360401.664294:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787360401.664301:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596194816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360401.664342:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596194816:12345-0@lo:400:kworker.0 Request processed in 42us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.664349:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787360401.664371:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194304 00000100:00100000:1.0:1787360401.664375:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194304 00000100:00100000:1.0:1787360401.664407:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360401.664414:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596194304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360401.664450:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596194304:12345-0@lo:400:kworker.0 Request processed in 37us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.664457:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787360401.664476:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360401.664489:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596194432:0@lo:8:kworker.0 00000100:00100000:1.0:1787360401.664519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787360401.664552:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890394b480 x1874182596193792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360401.664562:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787360401.664571:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787360401.664578:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787360401.664583:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787360401.664586:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998903737000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787360401.664592:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596193792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787360401.665477:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596194688:12345-0@lo:400:kworker.0 Request processed in 1510us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.665485:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787360401.665522:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb8e00 x1874182596194048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360401.665534:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596194048:0@lo:400:kworker.0 00010000:00080000:3.0:1787360401.665545:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edba300 x1874182596194688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360401.665553:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596194688:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.665563:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596193920:0@lo:400:kworker.0 00010000:00080000:3.0:1787360401.665584:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb9c00 x1874182596194560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360401.665592:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596194560:0@lo:400:kworker.0 00000100:00100000:3.0:1787360401.665627:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596194176:0@lo:400:kworker.0 00010000:00080000:3.0:1787360401.665638:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb9f80 x1874182596194816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360401.665648:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596194816:0@lo:400:kworker.0 00010000:00080000:3.0:1787360401.665657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb8700 x1874182596194304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360401.665665:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596194304:0@lo:400:kworker.0 00000100:00100000:0.0:1787360401.665785:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194432 00000100:00100000:0.0:1787360401.665791:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194432 00000100:00100000:0.0:1787360401.665846:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360401.665853:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596194432:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787360401.665902:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596194432:12345-0@lo:8:kworker.0 Request processed in 48us (1381us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787360401.665909:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360401.665946:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360401.665951:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360401.665955:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787360401.665958:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596194432:0@lo:8:kworker.0 00010000:00010000:2.0:1787360401.667086:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787360401.667646:0:25101:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787360401.667661:0:25101:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff998a3dcbcd28) 00000020:00000080:0.0:1787360401.667685:0:25101:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787360401.667755:0:25101:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3c2bf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787360401.667759:0:25101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3c2bf800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787360401.667761:0:25101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3c2bf800 3 00010000:00080000:0.0:1787360401.667796:0:25101:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a1a511000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360401.669960:0:25101:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787360401.670155:0:25101:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787360401.670196:0:25101:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360401.670211:0:25101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x359a4e2aee721c56 00000100:00080000:0.0:1787360401.670220:0:25101:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360401.670251:0:25101:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff998a1a511000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360401.670284:0:25101:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890394a300 x1874182596194944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360401.670349:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596194944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360401.670423:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360401.670488:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596194944 00000100:00100000:0.0:1787360401.670494:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596194944 00000100:00100000:0.0:1787360401.670526:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360401.670533:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596194944:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360401.670556:0:22770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:0.0:1787360401.670593:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x359a4e2aee721c5d 00000004:00100000:0.0:1787360401.670609:0:22770:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360401.670638:0:22770:0:(import.c:65:import_set_state_nolock()) ffff9989052e1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360401.670688:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874182596194944:12345-0@lo:38:llog_process_th.0 Request processed in 154us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360401.670696:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787360401.670731:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890394a300 x1874182596194944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360401.670741:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360401.670748:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787360401.670754:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787360401.670757:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787360401.670759:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a1a511000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787360401.670764:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596194944:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787360401.670780:0:25101:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787360401.670920:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360401.670925:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360401.670928:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360401.670931:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1787360401.672582:0:25101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787360401.672938:0:25088:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787360401.672966:0:25088:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787360401.673468:0:25088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c33 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.673480:0:25088:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee721c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c33 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787360401.673534:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787360401.673536:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360401.673537:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360401.673538:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360401.673539:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360401.673540:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360401.673546:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360401.673548:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360401.673550:0:25088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360401.673553:0:25088:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787360401.673555:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787360401.673556:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360401.673557:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360401.673559:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360401.673559:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360401.673561:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360401.673562:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360401.673563:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360401.673564:0:25088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360401.673586:0:25088:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787360401.673603:0:25088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596195072:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787360401.673666:0:25088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.673702:0:25088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360401.674725:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195072 00000100:00100000:3.0:1787360401.674735:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195072 00000100:00100000:3.0:1787360401.674783:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787360401.674792:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596195072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360401.674819:0:22763:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787360401.674832:0:22763:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787360401.676118:0:22763:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787360401.676137:0:22763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787360401.676312:0:22785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787360401.676318:0:22785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787360401.676347:0:22785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676364:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676372:0:22785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676379:0:22785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676416:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676430:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 24 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360401.676453:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596195200:0@lo:104: 00000100:00100000:1.0:1787360401.676513:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360401.676560:0:22785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676569:0:22785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 24 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360401.676578:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596195328:0@lo:104: 00000100:00100000:1.0:1787360401.676599:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360401.676614:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360401.676633:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195200 00000100:00100000:1.0:1787360401.676639:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195200 00000100:00100000:1.0:1787360401.676670:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195328 00000100:00100000:1.0:1787360401.676673:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195328 00000100:00100000:1.0:1787360401.676688:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360401.676695:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596195200:12345-0@lo:104: 00010000:00010000:1.0:1787360401.676708:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.676798:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360401.676804:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:22785:x1874182596195200:12345-0@lo:104: Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.676811:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360401.676828:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360401.676835:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596195328:12345-0@lo:104: 00010000:00010000:1.0:1787360401.676842:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360401.678976:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:25088:x1874182596195072:12345-0@lo:253:mount.lustre.0 Request processed in 4169us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360401.678989:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1787360401.681636:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360401.681650:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681673:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360401.681678:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681688:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360401.681695:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360401.681701:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787360401.681757:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681764:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360401.681786:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681793:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee721bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721be6 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681811:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360401.681815:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681821:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360401.681824:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681841:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360401.681848:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360401.681853:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787360401.681867:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681872:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360401.681886:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681892:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee721bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721bd8 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.681907:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360401.681909:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360401.681911:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360401.681926:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360401.681945:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596195456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360401.682068:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.682119:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596195584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360401.682143:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360401.682180:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195456 00000100:00100000:3.0:1787360401.682187:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195456 00010000:00010000:3.0:1787360401.682211:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 24 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360401.682265:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195584 00000100:00100000:3.0:1787360401.682269:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195584 00010000:00010000:3.0:1787360401.682282:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 25 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360401.682296:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360401.682304:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:3660:x1874182596195456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360401.682315:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360401.682321:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 25 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682344:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 25 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682360:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360401.682394:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:3660:x1874182596195456:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.682401:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360401.682417:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360401.682424:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3658:x1874182596195584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360401.682432:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360401.682436:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 24 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682445:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 24 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682456:0:22755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682471:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787360401.682486:0:22755:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006168501s 00010000:00010000:3.0:1787360401.682490:0:22755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682497:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682503:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682509:0:22755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682515:0:22755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360401.682518:0:22755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682525:0:22755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682533:0:22755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.682542:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360401.682568:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3658:x1874182596195584:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360401.682574:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360401.682627:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596195584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360401.682652:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596195456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360401.682839:0:25088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:25088:1874182596195072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360401.682858:0:25088:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787360401.682861:0:25088:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360401.682863:0:25088:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787360401.682864:0:25088:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360401.682866:0:25088:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360401.682867:0:25088:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360401.682869:0:25088:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360401.682870:0:25088:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787360401.682872:0:25088:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360401.682874:0:25088:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360401.682887:0:25088:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787360401.683170:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787360401.683179:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:22785:x1874182596195328:12345-0@lo:104: Request processed in 6344us (6577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360401.683187:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787360401.683246:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041200/0x359a4e2aee721be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721bdf expref: 23 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360401.683258:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596195200:0@lo:104: 00010000:00010000:1.0:1787360401.683270:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681c00/0x359a4e2aee721bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721bd1 expref: 22 pid: 22764 timeout: 779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360401.683278:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22785:1874182596195328:0@lo:104: 00010000:00010000:1.0:1787360401.683292:0:22785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.683300:0:22785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.683306:0:22785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360401.683312:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681e00/0x359a4e2aee721c64 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360401.684659:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787360401.690818:0:25088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787360401.695661:0:25088:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787360401.695671:0:25088:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787360401.695706:0:25088:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787360401.695750:0:25088:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787360401.695768:0:25088:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787360401.695787:0:25088:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787360401.696567:0:25088:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360401.696792:0:25088:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787360402.672656:0:25154:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360402.673139:0:25154:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360402.681893:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360403.193409:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596195712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360403.193484:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.193516:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195712 00000100:00100000:0.0:1787360403.193524:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195712 00000100:00100000:0.0:1787360403.193571:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787360403.193581:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596195712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360403.193613:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360403.193667:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596195712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360403.193674:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787360403.193997:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596195712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360403.200967:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596195840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360403.201036:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360403.201084:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360403.201091:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596195968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360403.201111:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195840 00000100:00100000:2.0:1787360403.201116:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.201118:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195840 00000100:00100000:2.0:1787360403.201161:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596195968 00000100:00100000:2.0:1787360403.201165:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596195968 00000100:00100000:3.0:1787360403.201174:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360403.201182:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596195840:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360403.201188:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360403.201193:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596195968:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1787360403.201211:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000004:00000024:2.0:1787360403.201213:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787360403.201268:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596195840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.201276:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787360403.201295:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360403.209028:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596195968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7824us (7901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.209058:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360403.209069:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596195968:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1787360403.209087:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a4380 x1874182596195840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.209100:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596195840:0@lo:13:osp-pre-0-1.0 10000000:01000000:0.0:1787360403.585098:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360403.585106:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a2f244000 from 14 10000000:01000000:0.0:1787360403.585112:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360403.585159:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.585183:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.585195:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360403.585219:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360403.585298:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.585347:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a225730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360403.585496:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196096 00000100:00100000:2.0:1787360403.585504:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196096 00000100:00100000:2.0:1787360403.585558:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787360403.585569:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596196096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360403.585584:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360403.585598:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71a00/0x359a4e2aee721c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721c6b expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.585622:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71a00/0x359a4e2aee721c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721c6b expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.585631:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71a00/0x359a4e2aee721c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c6b expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.585640:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71a00, rc 0) 00000100:00100000:2.0:1787360403.585685:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596196096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.585691:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787360403.586450:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360403.586473:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c72 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.586483:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721c72 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360403.586553:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787360403.586594:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.586620:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a225730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360403.586735:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196224 00000100:00100000:2.0:1787360403.586741:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196224 00000100:00100000:2.0:1787360403.586785:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787360403.586793:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596196224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787360403.586811:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787360403.586829:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787360403.586832:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787360403.586917:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596196224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.586932:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787360403.587030:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360403.587088:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360403.587094:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c72 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.587103:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3e33e000/0x359a4e2aee721c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c72 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360403.587121:0:22767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360403.587123:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a05a04000 from 14 10000000:01000000:0.0:1787360403.587126:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360403.587145:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.587152:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.587161:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360403.587175:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360403.587200:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.587265:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a225730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360403.587312:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196352 00000100:00100000:1.0:1787360403.587324:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196352 00000100:00100000:1.0:1787360403.587350:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787360403.587365:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596196352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360403.587374:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360403.587383:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681a00/0x359a4e2aee721c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721c79 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.587399:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681a00/0x359a4e2aee721c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721c79 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.587408:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681a00/0x359a4e2aee721c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c79 expref: 24 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.587415:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681a00, rc 0) 00000100:00100000:1.0:1787360403.587451:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596196352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360403.587457:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787360403.587514:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360403.587525:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c80 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.587544:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721c80 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360403.587583:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787360403.587612:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.587632:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a225730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360403.587670:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196480 00000100:00100000:1.0:1787360403.587674:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196480 00000100:00100000:1.0:1787360403.587702:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787360403.587708:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596196480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787360403.587719:0:22761:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787360403.587731:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787360403.587734:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787360403.587802:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596196480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360403.587808:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787360403.587905:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596196480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360403.587943:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360403.587951:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c80 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.587959:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3e33fc00/0x359a4e2aee721c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721c80 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.707776:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360403.708284:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360383/real 1787360383] req@ffff998904174000 x1874182596181504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360403.708311:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904174000 x1874182596181504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360403.708331:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360383/real 1787360383] req@ffff998904174380 x1874182596181632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360403.708342:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904174380 x1874182596181632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360403.708360:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360403.708375:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787360403.708380:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596181504:0@lo:8:kworker.0 00000100:00080000:2.0:1787360403.708385:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360403.708389:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787360403.708391:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596181632:0@lo:8:kworker.0 00000100:00080000:3.0:1787360403.708603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360403.708608:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787360403.708611:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360403.708615:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1787360403.708634:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787360403.708640:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998a0ffac000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360403.708669:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edbb800 x1874182596196608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360403.708689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360403.708692:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787360403.708694:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360403.708696:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:3.0:1787360403.708699:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787360403.708702:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a31370800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360403.708712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edb9c00 x1874182596196736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360403.708715:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596196608:0@lo:8:kworker.0 00000100:00080000:3.0:1787360403.708740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787360403.708743:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787360403.708745:0:8:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360403.708749:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787360403.708757:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edba300 x1874182596196992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360403.708774:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.708810:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596196864:0@lo:400:kworker.0 00000100:00100000:2.0:1787360403.708811:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596196736:0@lo:8:kworker.0 00000100:00100000:2.0:1787360403.708833:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.708835:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360403.708848:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596196992:0@lo:8:kworker.0 00000100:00100000:3.0:1787360403.708852:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596197504:0@lo:400:kworker.0 00000100:00100000:2.0:1787360403.708867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.708870:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.708887:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787360403.708892:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596197120:0@lo:400:kworker.0 00000100:00100000:2.0:1787360403.708901:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196608 00000100:00100000:2.0:1787360403.708907:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196608 00000100:00100000:3.0:1787360403.708919:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.708936:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596197632:0@lo:400:kworker.0 00000100:00100000:2.0:1787360403.708942:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196736 00000100:00100000:2.0:1787360403.708946:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196736 00000100:00100000:2.0:1787360403.708953:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196992 00000100:00100000:2.0:1787360403.708956:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196992 00000100:00100000:3.0:1787360403.708958:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360403.708966:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360403.708973:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596196608:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787360403.708982:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596197248:0@lo:400:kworker.0 00010000:00080000:2.0:1787360403.709001:0:24275:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000100:00100000:3.0:1787360403.709003:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.709014:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360403.709018:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596197376:0@lo:400:kworker.0 00000020:00000080:2.0:1787360403.709028:0:24275:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721c87 00000100:00100000:3.0:1787360403.709034:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1787360403.709042:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9989038ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787360403.709046:0:24275:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787360403.709048:0:24275:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787360403.709054:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596196864 00000100:00100000:3.0:1787360403.709057:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596196864 00000100:00100000:3.0:1787360403.709080:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197504 00000100:00100000:3.0:1787360403.709082:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197504 00000100:00100000:3.0:1787360403.709100:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197120 00000100:00100000:3.0:1787360403.709103:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197120 00000100:00100000:3.0:1787360403.709111:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197632 00000100:00100000:3.0:1787360403.709113:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197632 00002000:00080000:2.0:1787360403.709114:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787360403.709123:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197248 00000100:00100000:3.0:1787360403.709125:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197248 00000100:00080000:2.0:1787360403.709133:0:24275:0:(import.c:65:import_set_state_nolock()) ffff9989038ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360403.709134:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197376 00000100:00100000:3.0:1787360403.709136:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197376 00000100:00100000:3.0:1787360403.709146:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360403.709151:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360403.709177:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596196608:12345-0@lo:8:kworker.0 Request processed in 202us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.709181:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596196864:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.709184:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360403.709187:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360403.709199:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360403.709199:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360403.709203:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596196736:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787360403.709205:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596197504:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787360403.709217:0:24275:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000100:00100000:3.0:1787360403.709246:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596197504:12345-0@lo:400:kworker.0 Request processed in 41us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.709260:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:2.0:1787360403.709263:0:24275:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721c8e 00002000:00100000:2.0:1787360403.709270:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9989038af800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1787360403.709272:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00002000:00080000:2.0:1787360403.709273:0:24275:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787360403.709275:0:24275:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787360403.709278:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360403.709305:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596197120:12345-0@lo:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.709310:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00002000:00080000:2.0:1787360403.709414:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787360403.709427:0:24275:0:(import.c:65:import_set_state_nolock()) ffff9989038a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360403.709462:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596196736:12345-0@lo:8:kworker.0 Request processed in 257us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.709467:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360403.709672:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360403.709676:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596196992:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787360403.709691:0:24275:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:2.0:1787360403.709706:0:24275:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721c95 00002000:00100000:2.0:1787360403.709712:0:24275:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9989038ac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787360403.709715:0:24275:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787360403.709717:0:24275:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787360403.709737:0:24275:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787360403.709747:0:24275:0:(import.c:65:import_set_state_nolock()) ffff9989038ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360403.709772:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596196992:12345-0@lo:8:kworker.0 Request processed in 94us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.709777:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787360403.709817:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb9c00 x1874182596196736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360403.709826:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360403.709831:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787360403.709837:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787360403.709841:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787360403.709843:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a31370800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787360403.709860:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787360403.709864:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596196736:0@lo:8:kworker.0 00010000:00080000:2.0:1787360403.709873:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edba300 x1874182596196992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360403.709891:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787360403.709896:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787360403.709899:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787360403.709900:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360403.710435:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360403.710447:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596197632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360403.710491:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596197632:12345-0@lo:400:kworker.0 Request processed in 48us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.710497:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360403.710508:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787360403.710513:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596197248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360403.710565:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596197248:12345-0@lo:400:kworker.0 Request processed in 51us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.710571:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787360403.710583:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360403.710589:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596197376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360403.710616:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596197376:12345-0@lo:400:kworker.0 Request processed in 27us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.710621:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787360403.710653:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360403.710657:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787360403.710679:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405bb80 x1874182596197376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710701:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596197376:0@lo:400:kworker.0 00010000:00080000:3.0:1787360403.710714:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904058e00 x1874182596197248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710721:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596197248:0@lo:400:kworker.0 00010000:00080000:3.0:1787360403.710753:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb8e00 x1874182596197120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710763:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596197120:0@lo:400:kworker.0 00010000:00080000:3.0:1787360403.710774:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405a680 x1874182596197632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710781:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596197632:0@lo:400:kworker.0 00010000:00080000:3.0:1787360403.710792:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edb8000 x1874182596196864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710799:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596196864:0@lo:400:kworker.0 00010000:00080000:3.0:1787360403.710808:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059500 x1874182596197504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.710816:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596197504:0@lo:400:kworker.0 00000004:00080000:2.0:1787360403.711114:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787360403.711121:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596196992:0@lo:8:kworker.0 00010000:00080000:2.0:1787360403.711139:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edbb800 x1874182596196608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360403.711146:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360403.711152:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787360403.711158:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787360403.711161:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787360403.711164:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a0ffac000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787360403.711182:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787360403.711185:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596196608:0@lo:8:kworker.0 00000004:00080000:2.0:1787360403.711245:0:23514:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787360403.711278:0:23514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596197888:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787360403.711280:0:22794:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787360403.711291:0:22794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22794:1874182596198144:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360403.711390:0:22794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.711461:0:22794:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8d80 going to sleep for 11 seconds 00000004:00080000:3.0:1787360403.711477:0:22793:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787360403.711561:0:22793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681958334533ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787360403.711567:0:22793:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787360403.711592:0:23514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787360403.714812:0:22795:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787360403.714901:0:22795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681961674815ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787360403.714908:0:22795:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787360403.715058:0:22796:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787360403.715081:0:22796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22796:1874182596198400:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787360403.715143:0:23513:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787360403.715198:0:23513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 681961971434ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787360403.715202:0:23513:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787360403.715804:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198144 00000100:00100000:2.0:1787360403.715813:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198144 00000100:00100000:3.0:1787360403.715843:0:23514:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360403.715867:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197888 00000100:00100000:2.0:1787360403.715870:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197888 00000100:00100000:2.0:1787360403.715886:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360403.715895:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22794:x1874182596198144:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360403.715997:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596198016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360403.716000:0:22796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360403.716018:0:22796:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360403.716029:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787360403.716030:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360403.716036:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787360403.716053:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360403.716060:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596197760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360403.716079:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360403.716102:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198400 00000100:00100000:1.0:1787360403.716106:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198400 00000100:00100000:3.0:1787360403.716108:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198016 00000100:00100000:3.0:1787360403.716110:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198016 00000100:00100000:3.0:1787360403.716124:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596197760 00000100:00100000:3.0:1787360403.716127:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596197760 00000100:00100000:3.0:1787360403.716137:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360403.716142:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596198016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360403.716159:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787360403.716185:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360403.716192:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23514:x1874182596197888:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787360403.716198:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596198016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.716205:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360403.716219:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360403.716239:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3661:x1874182596197760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360403.716252:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360403.716278:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3661:x1874182596197760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.716283:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787360403.716326:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a4380 x1874182596197760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.716356:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596197760:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787360403.716370:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059500 x1874182596198016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.716381:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596198016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360403.716403:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360403.716410:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596198272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360403.716433:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.716454:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198272 00000100:00100000:3.0:1787360403.716457:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198272 00000100:00100000:3.0:1787360403.716474:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360403.716479:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596198272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360403.716488:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360403.716515:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596198272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360403.716521:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787360403.716543:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902916d80 x1874182596198272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.716554:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596198272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787360403.716660:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360403.716664:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787360403.726414:0:25219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787360403.726425:0:25219:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787360403.726525:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23514:x1874182596197888:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10329us (14927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360403.726536:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360403.726564:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360403.726575:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22796:x1874182596198400:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1787360403.726609:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a4700 x1874182596197888/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787360419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.726624:0:23514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596197888:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787360403.726635:0:23514:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787360403.726668:0:23514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596198528:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787360403.726708:0:23514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360403.726726:0:24276:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787360403.726729:0:23514:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360403.726733:0:24276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787360403.728410:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198528 00000100:00100000:0.0:1787360403.728421:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198528 00000100:00100000:0.0:1787360403.729684:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787360403.729704:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23514:x1874182596198528:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787360403.729736:0:25221:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787360403.729820:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23514:x1874182596198528:12345-0@lo:5:osp-pre-1-1.0 Request processed in 124us (3111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360403.729827:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787360403.730200:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059180 x1874182596198528/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.730215:0:23514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596198528:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787360403.730285:0:23514:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787360403.730341:0:23514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596198656:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787360403.730374:0:23514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.730399:0:23514:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360403.730427:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198656 00000100:00100000:0.0:1787360403.730434:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198656 00000100:00100000:0.0:1787360403.730918:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787360403.730981:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23514:x1874182596198656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787360403.731018:0:24276:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:2.0:1787360403.735008:0:24275:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787360403.735019:0:24275:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1787360403.735025:0:24275:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1787360403.735428:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787360403.735442:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787360403.739853:0:25219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787360403.739865:0:25219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1787360403.739872:0:25219:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00010000:2.0:1787360403.760042:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.760056:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.760072:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.760077:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.760083:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.760101:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.760111:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.760119:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.760145:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.760191:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.760205:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.760214:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.760218:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.760248:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.760271:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.760279:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee721c9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.760323:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.760326:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.760328:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.763597:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.763609:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763626:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.763630:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.763643:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763656:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763666:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763673:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763690:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.763700:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.763705:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763713:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.763718:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763726:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763740:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763757:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721ca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.763773:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.763775:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.763777:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.771287:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.771299:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771326:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.771331:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.771337:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771352:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771363:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771371:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771554:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.771566:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.771571:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771589:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.771593:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771602:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771619:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771627:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721caa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.771642:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.771643:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.771645:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.772304:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.772321:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.772332:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.772336:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.772341:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.772356:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.772364:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.772371:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.772391:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787360403.772610:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.772616:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.772625:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.772628:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.772632:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.772642:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.772655:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.772662:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.772676:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1787360403.773041:0:23502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:2.0:1787360403.773963:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360403.773973:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.773984:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.773989:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.773999:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774020:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774028:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721cb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774048:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.774052:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774067:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.774071:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774079:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774090:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774097:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d79748b3/0x359a4e2aee721cb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.774113:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.774114:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.774116:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.774559:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.774567:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.774579:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.774583:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.774589:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.774600:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.774609:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.774616:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.774651:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.777695:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.777710:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.777726:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.777730:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.777741:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.777773:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.777780:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721cbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.777799:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.777812:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.777814:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.779015:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.779690:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.779701:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779716:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.779720:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.779726:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779741:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779750:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779758:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779792:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.779817:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.779822:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779829:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.779833:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779841:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779856:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779863:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721cc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.779879:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.779881:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.779882:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787360403.780423:0:25089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787360403.780433:0:25089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787360403.780436:0:25089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787360403.781331:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23514:x1874182596198656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 50390us (50951us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787360403.781342:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:1.0:1787360403.781475:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.781482:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.781495:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.781499:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.781505:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.781517:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.781526:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.781534:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.781556:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360403.782021:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.782033:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782042:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.782045:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.782050:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782059:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782067:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782074:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782087:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787360403.782410:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.782416:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782425:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.782428:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.782432:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782440:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782453:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782458:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.782467:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787360403.782698:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787360403.782710:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782719:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.782723:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782732:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782748:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782754:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721ccd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782771:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360403.782774:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782779:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.782782:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782789:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782887:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782895:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721cd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782909:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.782912:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782918:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.782921:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782928:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782937:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782945:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721cdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.782956:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.783118:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.783123:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783133:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.783136:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.783140:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783150:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783158:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783165:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783183:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360403.783768:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.783775:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783784:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.783787:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.783791:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783799:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783874:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783881:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.783890:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787360403.784047:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.784058:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360403.784063:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784071:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.784075:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784082:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784095:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784102:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721ce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784116:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.784118:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784124:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.784127:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784134:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784155:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784162:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721ce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.784173:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.784175:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.784177:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.784184:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360403.784412:0:23514:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787360403.784422:0:23514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23514:1874182596198656:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787360403.784436:0:23514:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1787360403.784482:0:23514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23514:1874182596198784:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787360403.784539:0:23514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.784575:0:23514:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8180 going to sleep for 11 seconds 00002000:00010000:3.0:1787360403.784664:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.784670:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.784680:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.784683:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.784688:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.784698:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.784705:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.784713:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.784735:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360403.785151:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.785158:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.785166:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.785176:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.785184:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.785200:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.785207:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721cf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.785252:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.785254:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.785256:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.785374:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.785380:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785390:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.785393:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.785397:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785408:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785416:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785424:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785439:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.785447:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.785451:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785458:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.785467:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785475:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785486:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785493:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee721cf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.785507:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.785508:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.785510:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360403.785754:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198784 00000100:00100000:2.0:1787360403.785762:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198784 00000100:00100000:2.0:1787360403.785815:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360403.785825:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23514:x1874182596198784:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787360403.785903:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23514:x1874182596198784:12345-0@lo:900:osp-pre-1-1.0 Request processed in 79us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.785911:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:1.0:1787360403.786136:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.786143:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.786153:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.786156:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.786161:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.786170:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.786179:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.786194:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.786214:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1787360403.788072:0:23514:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059180 x1874182596198784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360419 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360403.788090:0:23514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23514:1874182596198784:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1787360403.788193:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.788201:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.788215:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.788219:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.788238:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.788268:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.788277:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.788285:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.788308:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360403.788585:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.788592:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788600:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.788604:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788613:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788631:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788638:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721cfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788658:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.788662:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788678:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.788682:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788689:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788701:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788707:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d79748b3/0x359a4e2aee721d05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.788721:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.788722:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.788724:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.789103:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.789109:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789119:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.789123:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.789127:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789137:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789151:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789157:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789173:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.789496:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.789502:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.789510:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.789514:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.789522:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.789541:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.789549:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd05c350/0x359a4e2aee721d0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.789563:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.789565:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.789566:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.789706:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.789712:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789721:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.789724:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.789728:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789736:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789743:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789752:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.789783:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.789943:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.789948:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.789955:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.789959:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.789973:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.789985:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.789991:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036abeefe/0x359a4e2aee721d13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.790009:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.790011:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.790013:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.791581:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.791592:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.791607:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.791610:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.791616:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.791627:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.791636:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.791644:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.791665:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.792155:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.792162:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792171:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.792176:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792185:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792202:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792209:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008800ab1b/0x359a4e2aee721d1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792255:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.792257:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.792259:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.792357:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.792363:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792372:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.792381:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.792386:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792396:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792404:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792411:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792429:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.792652:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.792657:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792675:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.792679:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792687:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792698:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792705:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fd96f19/0x359a4e2aee721d21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.792720:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.792721:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.792723:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.792786:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.792791:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792800:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.792813:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.792817:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792827:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792835:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792848:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.792865:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.793103:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.793108:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793115:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.793118:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793126:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793142:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793150:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016a295d8/0x359a4e2aee721d28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793162:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.793163:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.793165:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.793250:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.793255:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.793263:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.793266:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.793270:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.793279:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.793287:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.793295:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.793308:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.793428:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.793433:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793440:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.793444:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793452:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793462:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793470:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c3720b/0x359a4e2aee721d2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.793492:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.793494:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.793496:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.794297:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.794306:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794334:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.794337:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.794343:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794352:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794366:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794373:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794387:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.794516:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.794521:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.794528:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.794532:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.794540:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.794552:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.794560:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee721d36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.794575:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.794577:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.794578:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360403.794876:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.794882:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794892:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.794895:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.794899:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794909:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794929:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794935:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.794990:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360403.796062:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.796070:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.796082:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.796085:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.796090:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.796100:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.796108:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.796115:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360403.796293:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.796300:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.796308:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.796311:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.796325:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.796335:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.796342:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.796348:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796455:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787360403.796461:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796480:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.796484:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796492:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796507:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796514:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df10d5dd/0x359a4e2aee721d3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796531:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360403.796534:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796541:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.796544:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796551:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796560:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796573:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360403.796576:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796581:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360403.796584:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796590:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796599:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.796606:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.796608:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.796610:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.797389:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.797955:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787360403.797973:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8c57ef/0x359a4e2aee721d44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798110:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.798617:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.798625:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798638:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.798642:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.798648:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798674:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798684:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798692:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.798706:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787360403.799033:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.799039:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799048:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.799052:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.799056:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799065:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799073:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799089:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799152:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787360403.799436:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360403.799443:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799451:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.799456:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799464:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799482:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799489:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000301d9f9a/0x359a4e2aee721d52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799506:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.799510:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799527:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.799531:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799539:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799549:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799557:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d74ce69/0x359a4e2aee721d59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.799578:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.799579:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.799581:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.799655:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.799661:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799670:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.799673:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.799677:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799686:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799693:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799700:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.799721:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360403.800003:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.800008:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800016:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.800019:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800027:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800045:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800052:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6a1602/0x359a4e2aee721d60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800078:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.800080:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.800082:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.800150:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.800155:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800170:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.800172:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.800176:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800185:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800192:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800199:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800218:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360403.800473:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.800478:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800486:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.800489:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800496:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800506:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800513:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dfc8730/0x359a4e2aee721d67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.800539:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.800541:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.800543:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.800607:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.800613:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800621:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.800623:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.800628:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800636:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800654:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800661:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.800681:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360403.801035:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.801040:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.801047:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.801051:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.801058:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.801069:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.801076:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee721d6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.801090:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.801092:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.801094:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.801390:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.801396:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.801406:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.801409:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.801413:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.801423:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.801431:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.801439:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.801504:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.804818:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.804834:0:25219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721d4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360403.805676:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.805692:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.805725:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.805733:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.805742:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.805765:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.805780:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.805788:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.805802:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360403.806074:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.806091:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806101:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.806105:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806114:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806129:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806136:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee721d75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806151:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.806154:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806173:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.806177:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806185:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806195:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806202:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721d7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.806216:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.806218:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.806219:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.806657:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.806669:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.806685:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.806692:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.806700:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.806715:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.806729:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.806742:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.806773:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360403.807180:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360403.807186:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807200:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360403.807204:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807212:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807243:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807251:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee721d83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807267:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.807269:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.807270:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.807465:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.807472:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.807488:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.807504:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.807511:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.807530:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.807542:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.807554:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.807581:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360403.807708:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.807717:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807729:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.807735:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.807741:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807755:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807777:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807786:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.807794:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360403.807954:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.807960:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.807968:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.807972:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.807980:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808013:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808026:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee721d8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808046:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.808050:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808056:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.808059:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808065:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808076:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808096:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721d91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808107:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.808109:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.808115:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.808616:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.808628:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.808643:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.808649:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.808656:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.808672:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.808686:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.808699:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.808741:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360403.808940:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.808946:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808953:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.808957:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808966:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.808994:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.809006:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721d98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.809029:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.809031:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.809035:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.809373:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360403.809688:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.809699:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.809716:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.809723:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.809731:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.809816:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.809825:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.809842:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360403.809930:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787360403.809936:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.809949:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=682s v=(0 0) 00010000:00010000:0.0:1787360403.809951:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360403.809955:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.809975:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.809988:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.809999:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.810058:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360403.810659:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.810667:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810676:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33ee00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.810680:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810702:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810717:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810723:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054560078/0x359a4e2aee721da6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810740:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.810743:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810748:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.810751:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810758:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810766:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.810773:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.810775:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.810783:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360403.810978:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787360403.810984:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee721d9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360403.812595:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360403.812606:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.812620:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=682s v=(0 0) 00010000:00010000:3.0:1787360403.812624:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360403.812630:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.812642:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.812651:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.812659:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.812768:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.812775:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.812783:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.812787:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.812797:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.812824:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.812832:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.812833:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.812835:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.812907:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.812913:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.812922:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.812925:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.812929:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.812939:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.812946:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.812953:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.812972:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360403.813190:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.813196:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.813204:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.813208:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.813217:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.813254:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.813262:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee721db4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.813280:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.813281:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.813283:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.813381:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.813387:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813395:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.813404:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.813409:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813418:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813426:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813433:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813447:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360403.813587:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.813592:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.813600:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.813604:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.813611:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.813622:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.813630:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036abeefe/0x359a4e2aee721dbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.813641:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.813643:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.813644:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.813921:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.813927:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813934:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.813937:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.813940:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813949:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813956:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813970:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.813989:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360403.814105:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.814110:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.814118:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.814121:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.814140:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.814152:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.814159:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee721dc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.814172:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.814173:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.814175:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.814311:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.814326:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.814335:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.814338:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.814341:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.814350:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.814357:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.814365:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360403.814516:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360403.814523:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee721dad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360403.816592:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.816607:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.816624:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.816628:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.816633:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.816649:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.816661:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.816679:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817488:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360403.817500:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817514:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.817519:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817528:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817549:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817561:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.817565:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817572:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.817575:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817586:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817595:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.817619:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.817621:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.817623:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360403.822837:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360403.822860:0:25219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721dc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.823179:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.823817:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.823826:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.823840:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.823849:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.823861:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.823883:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.823903:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.823914:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.823985:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360403.826045:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.826059:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826074:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.826078:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.826091:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826105:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826114:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826122:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826149:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787360403.826638:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.826644:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826653:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.826657:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.826661:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826670:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826678:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826696:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.826705:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787360403.826942:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787360403.826950:0:24275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5dafdb5/0x359a4e2aee721dd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360403.827302:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.827309:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.827332:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.827335:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.827339:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.827348:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.827356:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.827364:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.827373:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787360403.827660:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.827666:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.827674:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.827677:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.827681:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.827691:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.827698:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.827705:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.827725:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787360403.828273:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.828280:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.828296:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.828299:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.828304:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.828323:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.828332:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.828340:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.828348:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787360403.828681:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.828687:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.828741:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.828745:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.828749:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.828758:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.828766:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.828773:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.828782:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787360403.829159:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.829166:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829174:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.829182:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.829187:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829196:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829204:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829211:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829219:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1787360403.829521:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.829527:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.829536:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.829539:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.829543:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.829552:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.829573:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.829580:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.829588:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1787360403.829846:0:24275:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360403.829852:0:24275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829860:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=682s v=(0 0) 00010000:00010000:1.0:1787360403.829863:0:24275:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360403.829867:0:24275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829876:0:24275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829884:0:24275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829897:0:24275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.829905:0:24275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00080000:1.0:1787360403.829937:0:24275:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1787360403.830102:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22794:x1874182596198144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114204us (118785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360403.830113:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360403.830354:0:22794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22794:1874182596198144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787360403.830369:0:22794:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787360403.830411:0:22794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22794:1874182596198912:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360403.830443:0:22794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.830476:0:22794:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3300 going to sleep for 11 seconds 00002000:00010000:2.0:1787360403.831150:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.831159:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.831172:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.831175:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.831179:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.831190:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.831199:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.831206:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.831248:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:1.0:1787360403.831794:0:25221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596198912 00000100:00100000:1.0:1787360403.831804:0:25221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596198912 00000100:00100000:1.0:1787360403.831860:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360403.831870:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22794:x1874182596198912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787360403.831910:0:25221:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:2.0:1787360403.833837:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.833849:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.833864:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.833868:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.833874:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.833887:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.833897:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.833904:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.833915:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:0.0:1787360403.836606:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1787360403.836621:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836636:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836641:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836653:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836675:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836683:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000502ba2f/0x359a4e2aee721dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836718:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1787360403.836723:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836730:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836743:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836751:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836760:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836767:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee721dde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836779:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1787360403.836783:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836789:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836793:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836800:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836808:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836814:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee721de5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836834:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787360403.836838:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836845:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836849:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836856:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836867:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836874:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721dec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836885:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787360403.836889:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836895:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836898:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836914:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836925:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836932:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3bab57d/0x359a4e2aee721df3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836946:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787360403.836949:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836955:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.836958:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836977:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836987:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.836993:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fd96f19/0x359a4e2aee721dfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837016:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787360403.837020:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837026:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837030:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837037:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837047:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837053:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfde3aed/0x359a4e2aee721e01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837063:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787360403.837067:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837073:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837076:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837096:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837105:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837112:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085fbf02d/0x359a4e2aee721e08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837122:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787360403.837126:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837132:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837134:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837141:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837151:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837157:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008800ab1b/0x359a4e2aee721e0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837181:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787360403.837185:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837192:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837195:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837202:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837212:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837219:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee721e16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837253:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360403.837257:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837263:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837267:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837284:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837295:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837302:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721e1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837325:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.837329:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837335:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.837337:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837344:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837353:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837360:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee721e24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.837384:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.837386:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.837388:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.837418:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.837420:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.837422:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.837863:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.837872:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.837884:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.837895:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.837901:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.837914:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.837923:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.837929:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.837950:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360403.838599:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.838605:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.838615:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.838618:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.838622:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.838631:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.838639:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.838653:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.838674:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360403.838931:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.838938:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.838945:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.838949:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360403.839090:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.839096:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839105:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.839108:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.839113:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839121:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839127:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839135:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839142:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360403.839397:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839416:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839432:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee721e2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839450:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360403.839454:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839461:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.839464:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839470:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839480:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839487:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6e88df0/0x359a4e2aee721e32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839498:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360403.839501:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839507:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360403.839516:0:22758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839524:0:22758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839535:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839542:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee721e39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360403.839554:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.839556:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.839558:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.839621:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.839698:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.839704:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839719:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.839722:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.839727:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839737:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839744:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839752:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.839771:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360403.840064:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.840070:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840078:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.840081:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.840086:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840095:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840115:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840124:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840145:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787360403.840405:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360403.840411:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840418:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.840422:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840430:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840442:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840449:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bd7d0b0/0x359a4e2aee721e40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840464:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.840468:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840480:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.840484:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840491:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840501:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840508:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef23550b/0x359a4e2aee721e47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.840520:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.840522:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.840524:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360403.840591:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360403.840597:0:25219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840607:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=682s v=(0 0) 00010000:00010000:2.0:1787360403.840610:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360403.840614:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840623:0:25219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840631:0:25219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.840638:0:25219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360403.841819:0:25219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787360403.842099:0:25219:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1787360403.842205:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22796:x1874182596198400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 115630us (126201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360403.842215:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360403.842610:0:22796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22796:1874182596198400:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360403.842626:0:22796:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787360403.842669:0:22796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22796:1874182596199040:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787360403.842706:0:22796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360403.842726:0:22796:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360403.842907:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199040 00000100:00100000:2.0:1787360403.842913:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199040 00000100:00100000:2.0:1787360403.842952:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360403.842969:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22796:x1874182596199040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787360403.843007:0:24276:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1787360403.844486:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22796:x1874182596199040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1512us (1775us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787360403.844496:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360403.844771:0:22796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22796:1874182596199040:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360403.844785:0:22796:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1787360403.847288:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360403.847300:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.847323:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360403.847328:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.847339:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.847368:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.847375:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf8e8c9/0x359a4e2aee721e4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360403.847392:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.847394:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360403.847396:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360403.847445:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787360403.853366:0:24270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1787360403.853413:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787360403.857208:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22794:x1874182596198912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25332us (26757us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787360403.857245:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360403.857447:0:22794:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787360403.857457:0:22794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22794:1874182596198912:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787360403.857472:0:22794:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:3.0:1787360404.291169:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787360404.729386:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360405.753861:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360406.783376:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787360407.631218:0:25446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787360407.801424:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360408.316507:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360408.316540:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596199296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360408.316588:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360408.316658:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199168 00000100:00100000:1.0:1787360408.316666:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199168 00000100:00100000:1.0:1787360408.316729:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360408.316739:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596199168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360408.316779:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787360408.316828:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596199168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360408.316835:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360408.316858:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360408.316912:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360408.317356:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199296 00000100:00100000:3.0:1787360408.317361:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199296 00000100:00100000:3.0:1787360408.317396:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360408.317403:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596199296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360408.317423:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360408.317465:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596199296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.317472:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360408.317503:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596199296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360408.317768:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596199424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360408.317808:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.317854:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199424 00000100:00100000:3.0:1787360408.317859:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199424 00000100:00100000:3.0:1787360408.317903:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360408.317909:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596199424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360408.317926:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787360408.317959:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596199424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.317965:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787360408.318024:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360408.318899:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596199424:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1787360408.417560:0:25498:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360408.417776:0:25498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787360408.827595:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596199552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360408.827665:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.827706:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360408.827712:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596199680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360408.827737:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.827772:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199552 00000100:00100000:3.0:1787360408.827790:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199552 00000100:00100000:3.0:1787360408.827835:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199680 00000100:00100000:3.0:1787360408.827839:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199680 00000100:00100000:3.0:1787360408.827858:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360408.827882:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596199552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360408.827910:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360408.827950:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596199552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.827956:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360408.827971:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360408.827978:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596199680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360408.827986:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360408.828009:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596199680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.828015:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787360408.828034:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360408.828065:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596199680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360408.828079:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596199552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360408.828203:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596199808:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.828255:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360408.828501:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360408.830568:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596200320:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.830637:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.830724:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596200832:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.830750:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.832896:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787360408.832914:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596199936:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.832976:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.836550:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596200448:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.836629:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.836656:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596200960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.836680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.836733:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199808 00000100:00100000:3.0:1787360408.836740:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199808 00000100:00100000:3.0:1787360408.836907:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787360408.836918:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3660:x1874182596199808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.836972:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3660:x1874182596199808:12345-0@lo:400:kworker.0 Request processed in 56us (8716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.836979:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787360408.837013:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200832 00000100:00100000:3.0:1787360408.837018:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200832 00000100:00100000:3.0:1787360408.837049:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200960 00000100:00100000:3.0:1787360408.837053:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200960 00000100:00100000:3.0:1787360408.837071:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787360408.837078:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596200832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837112:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596200832:12345-0@lo:400:kworker.0 Request processed in 34us (6360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.837118:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787360408.837129:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360408.837135:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596200960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837160:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596200960:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.837165:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360408.837190:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200448 00000100:00100000:3.0:1787360408.837193:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200448 00000100:00100000:3.0:1787360408.837216:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360408.837250:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596200448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837281:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596200448:12345-0@lo:400:kworker.0 Request processed in 34us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.837298:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360408.837333:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596200192:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837358:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837377:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596200704:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837397:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837413:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596201216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360408.837433:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837453:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787360408.837460:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596200064:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837481:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837498:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596200576:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837533:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596201088:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837552:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360408.837574:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200192 00000100:00100000:3.0:1787360408.837577:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200192 00000100:00100000:3.0:1787360408.837593:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200704 00000100:00100000:3.0:1787360408.837596:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200704 00000100:00100000:3.0:1787360408.837608:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200576 00000100:00100000:3.0:1787360408.837610:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200576 00000100:00100000:3.0:1787360408.837620:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201088 00000100:00100000:3.0:1787360408.837622:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201088 00000100:00100000:3.0:1787360408.837635:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360408.837641:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596200192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837685:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596200192:12345-0@lo:400:kworker.0 Request processed in 44us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.837692:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360408.837704:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360408.837710:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596200704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.837752:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596200704:12345-0@lo:400:kworker.0 Request processed in 42us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.837759:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360408.837771:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787360408.838923:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200064 00000100:00100000:2.0:1787360408.838932:0:25219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200064 00000100:00100000:2.0:1787360408.838990:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360408.839000:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360408.839056:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596200064:12345-0@lo:400:kworker.0 Request processed in 58us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360408.839061:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360408.839133:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360408.839142:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596201088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360408.839172:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596201088:12345-0@lo:400:kworker.0 Request processed in 33us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360408.839192:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787360408.839210:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360408.839215:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360408.839217:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360408.839336:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596200448:0@lo:400:kworker.0 00010000:00080000:2.0:1787360408.839356:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904915f80 x1874182596200960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.839366:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596200960:0@lo:400:kworker.0 00000100:00100000:2.0:1787360408.839377:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596199808:0@lo:400:kworker.0 00010000:00080000:2.0:1787360408.839389:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904914380 x1874182596200832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.839397:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596200832:0@lo:400:kworker.0 00000100:00100000:2.0:1787360408.839473:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201216 00000100:00100000:2.0:1787360408.839477:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201216 00000100:00100000:2.0:1787360408.839503:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360408.839510:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596201216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360408.839525:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360408.839558:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596201216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360408.839563:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360408.839600:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596200064:0@lo:400:kworker.0 00010000:00080000:2.0:1787360408.839616:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904917100 x1874182596201088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.839635:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596201088:0@lo:400:kworker.0 00010000:00080000:2.0:1787360408.839649:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904915180 x1874182596200192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.839657:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596200192:0@lo:400:kworker.0 00010000:00080000:2.0:1787360408.839666:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904915880 x1874182596200704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.839672:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596200704:0@lo:400:kworker.0 00000100:00100000:2.0:1787360408.839686:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596201216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360408.839884:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596200576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.839925:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596200576:12345-0@lo:400:kworker.0 Request processed in 2148us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360408.839932:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787360408.840079:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904915c00 x1874182596200576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360408.840088:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596200576:0@lo:400:kworker.0 00000100:00100000:1.0:1787360408.840485:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596200320 00000100:00100000:1.0:1787360408.840491:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596200320 00000100:00100000:1.0:1787360408.840537:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596199936 00000100:00100000:1.0:1787360408.840540:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596199936 00000100:00100000:1.0:1787360408.840556:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787360408.840562:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596200320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360408.840612:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596200320:12345-0@lo:400:kworker.0 Request processed in 49us (9974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360408.840618:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787360408.840634:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787360408.840640:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596199936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360408.840670:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596199936:12345-0@lo:400:kworker.0 Request processed in 31us (7694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360408.840676:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360408.841993:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596199936:0@lo:400:kworker.0 00000100:00100000:3.0:1787360408.842009:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596200320:0@lo:400:kworker.0 00000020:00000004:0.0:1787360409.239881:0:25548:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360409.240182:0:25548:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787360409.451026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.451217:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113216 00000100:00100000:0.0:1787360409.451267:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113216 00000100:00100000:0.0:1787360409.451320:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:0.0:1787360409.451328:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1874182575113216:12345-192.168.206.11@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787360409.451433:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a1ccd43f-7c56-4917-88d4-56dbba5a33ca@192.168.206.11@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:2.0:1787360409.451534:0:22763:0:(genops.c:1385:class_connect()) connect: client a1ccd43f-7c56-4917-88d4-56dbba5a33ca, cookie 0x359a4e2aee721e55 00000100:00080000:2.0:1787360409.451747:0:22763:0:(import.c:65:import_set_state_nolock()) ffff9989038a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360409.451917:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+5:2398:x1874182575113216:12345-192.168.206.11@tcp:250:mount.lustre.0 Request processed in 587us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360409.451927:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:1.0:1787360409.456394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.456881:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113344 00000100:00100000:3.0:1787360409.456893:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113344 00000100:00100000:3.0:1787360409.457091:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:3.0:1787360409.457105:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+5:18062:x1874182575113344:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360409.457124:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360409.457146:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516a00/0x359a4e2aee721e5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef587 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.457180:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516a00/0x359a4e2aee721e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef587 expref: 6 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.457213:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516a00/0x359a4e2aee721e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef587 expref: 6 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.457270:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516a00, rc 0) 00000100:00100000:3.0:1787360409.457355:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+6:18062:x1874182575113344:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 252us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360409.457364:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:1.0:1787360409.463762:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.464813:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113472 00000100:00100000:3.0:1787360409.464839:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113472 00000100:00100000:3.0:1787360409.464915:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:3.0:1787360409.465026:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+6:18062:x1874182575113472:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787360409.465183:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+6:18062:x1874182575113472:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 257us (1435us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360409.465193:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1787360409.472397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.472496:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113600 00000100:00100000:3.0:1787360409.472510:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113600 00000100:00100000:3.0:1787360409.472706:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:3.0:1787360409.472720:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+6:18062:x1874182575113600:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360409.472738:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360409.472758:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517400/0x359a4e2aee721e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef58e expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.472803:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517400/0x359a4e2aee721e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef58e expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.472815:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517400/0x359a4e2aee721e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef58e expref: 7 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360409.472849:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517400, rc 0) 00000100:00100000:3.0:1787360409.472926:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+7:18062:x1874182575113600:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 209us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360409.473395:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:0.0:1787360409.476767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360409.476985:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113728 00000100:00100000:2.0:1787360409.476998:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113728 00000100:00100000:2.0:1787360409.477108:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:2.0:1787360409.477119:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+7:18062:x1874182575113728:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360409.477395:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18062:x1874182575113728:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 277us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360409.477405:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:2.0:1787360409.482251:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.482451:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113856 00000100:00100000:1.0:1787360409.482465:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113856 00000100:00100000:1.0:1787360409.482538:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1787360409.482562:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18062:x1874182575113856:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787360409.482832:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18062:x1874182575113856:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 272us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.482841:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:2.0:1787360409.487316:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.487910:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575113984 00000100:00100000:0.0:1787360409.487924:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575113984 00000100:00100000:0.0:1787360409.488008:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:0.0:1787360409.488020:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575113984:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360409.488263:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575113984:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 207us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.488281:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:0.0:1787360409.531520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.531769:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114112 00000100:00100000:1.0:1787360409.531783:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114112 00000100:00100000:1.0:1787360409.531851:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:1.0:1787360409.531865:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575114112:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360409.532072:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575114112:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 209us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.532082:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:2.0:1787360409.538024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.538189:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114240 00000100:00100000:3.0:1787360409.538203:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114240 00000100:00100000:3.0:1787360409.538330:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:3.0:1787360409.538343:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575114240:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360409.538669:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18081:x1874182575114240:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 328us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360409.538679:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:2.0:1787360409.549897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.549976:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114368 00000100:00100000:0.0:1787360409.549990:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114368 00000100:00100000:0.0:1787360409.550188:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1787360409.550201:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a10be3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+8:18062:x1874182575114368:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360409.550220:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360409.550294:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3e33f400/0x359a4e2aee721e6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef5bf expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.550332:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3e33f400/0x359a4e2aee721e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5bf expref: 9 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.550344:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3e33f400/0x359a4e2aee721e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5bf expref: 9 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.550354:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f400, rc 0) 00000100:00100000:0.0:1787360409.550455:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a10be3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+9:18062:x1874182575114368:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 256us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.550463:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1787360409.562138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.563671:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114496 00000100:00100000:1.0:1787360409.563689:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114496 00000100:00100000:1.0:1787360409.563830:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1787360409.563843:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+9:18062:x1874182575114496:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787360409.563884:0:22761:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787360409.563913:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787360409.563919:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787360409.563922:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787360409.563925:0:22761:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787360409.563928:0:22761:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787360409.572909:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+9:18062:x1874182575114496:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 9052us (10768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.572929:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:2.0:1787360409.579319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.579966:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114624 00000100:00100000:0.0:1787360409.579981:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114624 00000100:00100000:0.0:1787360409.580060:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:0.0:1787360409.580073:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+9:18062:x1874182575114624:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360409.580094:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360409.580135:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef5c6 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.580173:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.580185:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 10 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360409.580196:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f800, rc 0) 00000100:00100000:0.0:1787360409.580319:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18062:x1874182575114624:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 248us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.580328:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1787360409.582604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.582695:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114752 00000100:00100000:1.0:1787360409.582708:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114752 00000100:00100000:1.0:1787360409.582771:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1787360409.582783:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18062:x1874182575114752:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360409.582979:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18062:x1874182575114752:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 198us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.582990:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:2.0:1787360409.587205:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.588011:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575114880 00000100:00100000:1.0:1787360409.588027:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575114880 00000100:00100000:1.0:1787360409.588156:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:1.0:1787360409.588169:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18062:x1874182575114880:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787360409.588412:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18062:x1874182575114880:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 245us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.588422:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:2.0:1787360409.599265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.599473:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115008 00000100:00100000:1.0:1787360409.599487:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115008 00000100:00100000:1.0:1787360409.599557:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:1.0:1787360409.599568:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18086:x1874182575115008:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360409.599762:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18086:x1874182575115008:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 195us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.599772:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:2.0:1787360409.612813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.612926:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115136 00000100:00100000:1.0:1787360409.612954:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115136 00000100:00100000:1.0:1787360409.613023:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:1.0:1787360409.613035:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18086:x1874182575115136:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360409.613217:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18086:x1874182575115136:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 182us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.613271:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:2.0:1787360409.623451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.624029:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115264 00000100:00100000:3.0:1787360409.624043:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115264 00000100:00100000:3.0:1787360409.624106:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360409.624117:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182575115264:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787360409.624154:0:24584:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c61ba93f-dce6-49e7-928d-2c5364490956@192.168.206.11@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1787360409.624215:0:24584:0:(genops.c:1385:class_connect()) connect: client c61ba93f-dce6-49e7-928d-2c5364490956, cookie 0x359a4e2aee721e78 00000004:00100000:3.0:1787360409.624273:0:24584:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787360409.624648:0:24584:0:(import.c:65:import_set_state_nolock()) ffff998a30856000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360409.624740:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+6:2398:x1874182575115264:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 623us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360409.624750:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360409.624810:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.624992:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115520 00000100:00100000:0.0:1787360409.624999:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115520 00000100:00100000:0.0:1787360409.625037:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:0.0:1787360409.625044:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874182575115520:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787360409.625068:0:22769:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c61ba93f-dce6-49e7-928d-2c5364490956@192.168.206.11@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:0.0:1787360409.625108:0:22769:0:(genops.c:1385:class_connect()) connect: client c61ba93f-dce6-49e7-928d-2c5364490956, cookie 0x359a4e2aee721e7f 00000004:00100000:0.0:1787360409.625126:0:22769:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787360409.625337:0:22769:0:(import.c:65:import_set_state_nolock()) ffff9989052e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360409.625382:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:2398:x1874182575115520:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 337us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.625389:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1787360409.634606:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.634658:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.634762:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115648 00000100:00100000:0.0:1787360409.634774:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115648 00000100:00100000:0.0:1787360409.634876:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115392 00000100:00100000:0.0:1787360409.634880:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115392 00000100:00100000:0.0:1787360409.634930:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1787360409.634942:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+6:0:x1874182575115648:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360409.634988:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360409.635085:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+6:0:x1874182575115648:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 145us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360409.635092:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360409.635102:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+6:0:x1874182575115392:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360409.635134:0:24584:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1787360409.635142:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360409.635147:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360409.635178:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+6:0:x1874182575115392:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 79us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.643728:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1787360409.645947:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360409.646346:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.646429:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115776 00000100:00100000:1.0:1787360409.646442:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115776 00000100:00100000:1.0:1787360409.646512:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:1.0:1787360409.646525:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575115776:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787360409.646565:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787360409.646661:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575115776:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 139us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.646668:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360409.649370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360409.649464:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575115904 00000100:00100000:0.0:1787360409.649486:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575115904 00000100:00100000:0.0:1787360409.649558:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1787360409.649571:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575115904:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787360409.649676:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575115904:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.649683:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1787360409.654648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360409.656638:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116288 00000100:00100000:2.0:1787360409.656660:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116288 00000100:00100000:2.0:1787360409.656760:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360409.656781:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575116288:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787360409.656912:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575116288:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 134us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360409.656922:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:3.0:1787360409.658999:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.659107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360409.659137:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116032 00000100:00100000:3.0:1787360409.659148:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116032 00000100:00100000:3.0:1787360409.659182:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116160 00000100:00100000:3.0:1787360409.659184:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116160 00000100:00100000:3.0:1787360409.659201:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1787360409.659210:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874182575116032:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787360409.659281:0:24273:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c61ba93f-dce6-49e7-928d-2c5364490956@192.168.206.11@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1787360409.659331:0:24273:0:(genops.c:1385:class_connect()) connect: client c61ba93f-dce6-49e7-928d-2c5364490956, cookie 0x359a4e2aee721e86 00002000:00100000:3.0:1787360409.659347:0:24273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c61ba93f-dce6-49e7-928d-2c5364490956/ffff998a30853000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787360409.659359:0:24273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787360409.660176:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360409.660186:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1874182575116160:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360409.660218:0:25221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c61ba93f-dce6-49e7-928d-2c5364490956@192.168.206.11@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:1.0:1787360409.660271:0:25221:0:(genops.c:1385:class_connect()) connect: client c61ba93f-dce6-49e7-928d-2c5364490956, cookie 0x359a4e2aee721e8d 00002000:00100000:1.0:1787360409.660281:0:25221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c61ba93f-dce6-49e7-928d-2c5364490956/ffff998903891000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360409.660301:0:25221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360409.660456:0:25221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360409.660517:0:25221:0:(import.c:65:import_set_state_nolock()) ffff998903897800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360409.660595:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c61ba93f-dce6-49e7-928d-2c5364490956+6:2398:x1874182575116160:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 408us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.660603:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00002000:00080000:0.0:1787360409.665446:0:24273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787360409.665510:0:24273:0:(import.c:65:import_set_state_nolock()) ffff9989052e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360409.665606:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:2398:x1874182575116032:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 6394us (6618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.665618:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000001:00100000:0.0:1787360409.670002:0:25089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c61ba93f-dce6-49e7-928d-2c5364490956 00000001:00080000:0.0:1787360409.670024:0:25089:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:2.0:1787360409.670447:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c61ba93f-dce6-49e7-928d-2c5364490956 00000100:00100000:0.0:1787360409.677800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360409.677952:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116416 00000100:00100000:2.0:1787360409.677984:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116416 00000100:00100000:2.0:1787360409.678058:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1787360409.678083:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575116416:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787360409.680303:0:22772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2111us 00000004:00200000:0.0:1787360409.699275:0:22772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787360409.699471:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18062:x1874182575116416:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 21393us (21680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360409.699491:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00010000:00010000:1.0:1787360409.851689:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360409.869460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360409.869677:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116544 00000100:00100000:1.0:1787360409.869692:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116544 00000100:00100000:1.0:1787360409.869768:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:1.0:1787360409.869781:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18109:x1874182575116544:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:1.0:1787360409.869805:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360409.869837:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee721e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef5f7 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.869920:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.869937:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.869957:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360409.870019:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360409.870023:0:22769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360409.870070:0:22769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.870104:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee721e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5f7 expref: 8 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.870139:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5f7 expref: 7 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360409.870148:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:1.0:1787360409.870151:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360409.870155:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee400, rc 0) 00000100:00100000:1.0:1787360409.870297:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+7:18109:x1874182575116544:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 517us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360409.870304:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00010000:00010000:1.0:1787360410.873446:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360411.259284:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787360411.781219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360411.781330:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116672 00000100:00100000:0.0:1787360411.781344:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116672 00000100:00100000:0.0:1787360411.781511:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:0.0:1787360411.781524:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+7:18162:x1874182575116672:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:0.0:1787360411.781576:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787360411.781694:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+7:18162:x1874182575116672:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 172us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360411.781703:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00080000:2.0:1787360411.783873:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360411.789309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360411.791681:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116800 00000100:00100000:1.0:1787360411.791700:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116800 00000100:00100000:1.0:1787360411.791824:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:1.0:1787360411.791837:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18162:x1874182575116800:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:1.0:1787360411.791881:0:22769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360411.793222:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18162:x1874182575116800:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 1376us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360411.793251:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:2.0:1787360411.797000:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360411.808354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360411.811531:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575116928 00000100:00100000:2.0:1787360411.811554:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575116928 00000100:00100000:2.0:1787360411.811757:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1787360411.811771:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c61ba93f-dce6-49e7-928d-2c5364490956+5:18162:x1874182575116928:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:2.0:1787360411.811812:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360411.811945:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c61ba93f-dce6-49e7-928d-2c5364490956+5:18162:x1874182575116928:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 176us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360411.811954:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00080000:3.0:1787360411.813432:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360411.816511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360411.824648:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117056 00000100:00100000:2.0:1787360411.824668:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117056 00000100:00100000:2.0:1787360411.825077:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360411.825092:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c61ba93f-dce6-49e7-928d-2c5364490956+5:18162:x1874182575117056:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:2.0:1787360411.825137:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360411.825291:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c61ba93f-dce6-49e7-928d-2c5364490956+5:18162:x1874182575117056:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 202us (8866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360411.825299:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00080000:3.0:1787360411.829130:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787360411.901255:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360412.002455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.002700:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117184 00000100:00100000:3.0:1787360412.002716:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117184 00000100:00100000:3.0:1787360412.002809:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:3.0:1787360412.002822:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+10:18196:x1874182575117184:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360412.002853:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360412.002895:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516000/0x359a4e2aee721ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef5fe expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.002952:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516000/0x359a4e2aee721ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5fe expref: 11 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.002967:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516000/0x359a4e2aee721ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5fe expref: 11 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.002979:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:3.0:1787360412.003065:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117184:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 246us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.003073:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:1.0:1787360412.006797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.007560:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117312 00000100:00100000:3.0:1787360412.007575:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117312 00000100:00100000:3.0:1787360412.007658:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:3.0:1787360412.007671:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117312:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787360412.009116:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117312:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 1431us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.009133:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:1.0:1787360412.014868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.015164:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117440 00000100:00100000:3.0:1787360412.015178:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117440 00000100:00100000:3.0:1787360412.015289:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:3.0:1787360412.015301:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117440:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787360412.015507:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117440:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 207us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.015517:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1787360412.028802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.029285:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117568 00000100:00100000:3.0:1787360412.029298:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117568 00000100:00100000:3.0:1787360412.029359:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:3.0:1787360412.029371:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117568:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360412.030070:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117568:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 695us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.030081:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:2.0:1787360412.065082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.066021:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117696 00000100:00100000:1.0:1787360412.066056:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117696 00000100:00100000:1.0:1787360412.066146:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:1.0:1787360412.066158:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117696:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360412.066574:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117696:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 415us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.066584:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:1.0:1787360412.074190:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.075854:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117824 00000100:00100000:3.0:1787360412.075875:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117824 00000100:00100000:3.0:1787360412.075967:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:3.0:1787360412.075979:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117824:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360412.076183:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18201:x1874182575117824:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 205us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.076192:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:2.0:1787360412.079056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360412.079193:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575117952 00000100:00100000:0.0:1787360412.079206:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575117952 00000100:00100000:0.0:1787360412.079316:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1787360412.079328:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18196:x1874182575117952:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360412.079347:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360412.079369:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3e33f000/0x359a4e2aee721ea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef62f expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360412.079412:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3e33f000/0x359a4e2aee721ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef62f expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360412.079424:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3e33f000/0x359a4e2aee721ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef62f expref: 12 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360412.079435:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f000, rc 0) 00000100:00100000:0.0:1787360412.079507:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18196:x1874182575117952:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360412.079514:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:2.0:1787360412.083683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.084024:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118080 00000100:00100000:1.0:1787360412.084038:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118080 00000100:00100000:1.0:1787360412.084111:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:1.0:1787360412.084124:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18196:x1874182575118080:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787360412.084158:0:22763:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787360412.084189:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787360412.084193:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787360412.084197:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787360412.084200:0:22763:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787360412.084203:0:22763:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787360412.088281:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18196:x1874182575118080:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 4104us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.088300:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:2.0:1787360412.091390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.091517:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118208 00000100:00100000:3.0:1787360412.091532:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118208 00000100:00100000:3.0:1787360412.091658:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:3.0:1787360412.091671:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18196:x1874182575118208:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360412.091692:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360412.091716:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef636 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.091752:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.091777:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 13 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360412.091800:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:3.0:1787360412.091894:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18196:x1874182575118208:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 224us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.091902:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1787360412.094479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.094599:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118336 00000100:00100000:1.0:1787360412.094613:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118336 00000100:00100000:1.0:1787360412.094680:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:1.0:1787360412.094693:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18196:x1874182575118336:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360412.095640:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18196:x1874182575118336:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 942us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.095673:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:2.0:1787360412.098355:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.098453:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118464 00000100:00100000:3.0:1787360412.098467:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118464 00000100:00100000:3.0:1787360412.098540:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:3.0:1787360412.098554:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18196:x1874182575118464:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787360412.098752:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18196:x1874182575118464:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 200us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.098770:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1787360412.101928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.102197:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118592 00000100:00100000:1.0:1787360412.102209:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118592 00000100:00100000:1.0:1787360412.102313:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:1.0:1787360412.102325:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18206:x1874182575118592:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360412.102516:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18206:x1874182575118592:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 192us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.102525:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:2.0:1787360412.114360:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360412.114442:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118720 00000100:00100000:0.0:1787360412.114456:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118720 00000100:00100000:0.0:1787360412.114524:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:0.0:1787360412.114537:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18206:x1874182575118720:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360412.114742:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18206:x1874182575118720:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 206us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360412.114752:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:2.0:1787360412.136099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360412.136155:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.136262:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118848 00000100:00100000:1.0:1787360412.136286:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118848 00000100:00100000:1.0:1787360412.136332:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119104 00000100:00100000:1.0:1787360412.136335:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119104 00000100:00100000:1.0:1787360412.136367:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360412.136378:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182575118848:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787360412.136414:0:24584:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0d96d89d-c68a-4f37-a626-1a4c9be7a00b@192.168.206.11@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787360412.136470:0:24584:0:(genops.c:1385:class_connect()) connect: client 0d96d89d-c68a-4f37-a626-1a4c9be7a00b, cookie 0x359a4e2aee721eb7 00000004:00100000:1.0:1787360412.136499:0:24584:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787360412.136624:0:24584:0:(import.c:65:import_set_state_nolock()) ffff998903893800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360412.136703:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2398:x1874182575118848:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 325us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.136713:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360412.136735:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360412.136739:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182575119104:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787360412.136757:0:24584:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0d96d89d-c68a-4f37-a626-1a4c9be7a00b@192.168.206.11@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787360412.136803:0:24584:0:(genops.c:1385:class_connect()) connect: client 0d96d89d-c68a-4f37-a626-1a4c9be7a00b, cookie 0x359a4e2aee721ebe 00000004:00100000:1.0:1787360412.136819:0:24584:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787360412.136888:0:24584:0:(import.c:65:import_set_state_nolock()) ffff998903895800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360412.136914:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2398:x1874182575119104:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 174us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.136922:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1787360412.146324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360412.146375:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360412.146444:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575118976 00000100:00100000:0.0:1787360412.146456:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575118976 00000100:00100000:0.0:1787360412.146544:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119232 00000100:00100000:0.0:1787360412.146549:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119232 00000100:00100000:0.0:1787360412.146580:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360412.146594:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:0:x1874182575118976:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360412.146631:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787360412.146711:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:0:x1874182575118976:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360412.146719:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360412.146739:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360412.146746:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:0:x1874182575119232:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360412.146760:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360412.146787:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:0:x1874182575119232:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360412.146794:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00080000:2.0:1787360412.147841:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360412.147851:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360412.148019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.151354:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119360 00000100:00100000:1.0:1787360412.151375:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119360 00000100:00100000:1.0:1787360412.151463:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1787360412.151476:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119360:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787360412.151514:0:22771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787360412.151600:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119360:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 126us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.151608:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1787360412.160280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.160461:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119488 00000100:00100000:3.0:1787360412.160474:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119488 00000100:00100000:3.0:1787360412.160544:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1787360412.160556:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119488:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787360412.161003:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119488:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 446us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.161013:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360412.165434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360412.165483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360412.165579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.165631:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119872 00000100:00100000:3.0:1787360412.165646:0:22781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119872 00000100:00100000:3.0:1787360412.165721:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1787360412.165734:0:22781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119872:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787360412.165864:0:22781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575119872:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 131us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.165892:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1787360412.168522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360412.168673:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120000 00000100:00100000:3.0:1787360412.168686:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120000 00000100:00100000:3.0:1787360412.168750:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1787360412.168772:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575120000:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787360412.168902:0:22773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787360412.169013:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18196:x1874182575120000:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 243us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360412.169022:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1787360412.175935:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119616 00000100:00100000:0.0:1787360412.175958:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119616 00000100:00100000:0.0:1787360412.176043:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575119744 00000100:00100000:0.0:1787360412.176049:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575119744 00000100:00100000:2.0:1787360412.176064:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787360412.176084:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182575119616:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787360412.176133:0:25219:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0d96d89d-c68a-4f37-a626-1a4c9be7a00b@192.168.206.11@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1787360412.176172:0:25219:0:(genops.c:1385:class_connect()) connect: client 0d96d89d-c68a-4f37-a626-1a4c9be7a00b, cookie 0x359a4e2aee721ec5 00002000:00100000:2.0:1787360412.176188:0:25219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d96d89d-c68a-4f37-a626-1a4c9be7a00b/ffff998a3efff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787360412.176199:0:25219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787360412.176332:0:25219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787360412.176375:0:25219:0:(import.c:65:import_set_state_nolock()) ffff998a3effe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360412.176486:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2398:x1874182575119616:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 403us (11002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.187532:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1787360412.187549:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874182575119744:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360412.187605:0:24276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0d96d89d-c68a-4f37-a626-1a4c9be7a00b@192.168.206.11@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787360412.187666:0:24276:0:(genops.c:1385:class_connect()) connect: client 0d96d89d-c68a-4f37-a626-1a4c9be7a00b, cookie 0x359a4e2aee721ecc 00002000:00100000:1.0:1787360412.187683:0:24276:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0d96d89d-c68a-4f37-a626-1a4c9be7a00b/ffff998a31301000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360412.187694:0:24276:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360412.187972:0:24276:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360412.188017:0:24276:0:(import.c:65:import_set_state_nolock()) ffff998a4033d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360412.188115:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2398:x1874182575119744:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 566us (22533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.188136:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1787360412.196981:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1787360412.355785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360412.356054:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120128 00000100:00100000:1.0:1787360412.356067:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120128 00000100:00100000:1.0:1787360412.356143:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1787360412.356155:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18229:x1874182575120128:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:1.0:1787360412.356179:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360412.356205:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee721ed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef667 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356336:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356352:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356365:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360412.356420:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360412.356424:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360412.356448:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356479:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee721ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 8 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356499:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360412.356529:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:1.0:1787360412.356532:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360412.356537:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:1.0:1787360412.356720:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+7:18229:x1874182575120128:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 566us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360412.356728:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00010000:00010000:1.0:1787360412.921414:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360413.434321:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596201344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360413.434321:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596201600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360413.434434:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360413.434525:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201600 00000100:00100000:1.0:1787360413.434533:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201600 00000100:00100000:1.0:1787360413.434589:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360413.434599:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596201600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360413.434649:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360413.434711:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596201600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360413.434719:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787360413.434848:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596201600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360413.434907:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360413.434944:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360413.434952:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596201472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360413.434981:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360413.435370:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201344 00000100:00100000:0.0:1787360413.435376:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201344 00000100:00100000:0.0:1787360413.435450:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360413.435461:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596201344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360413.435482:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787360413.435539:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596201344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360413.435543:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201472 00000100:00100000:0.0:1787360413.435548:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360413.435549:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201472 00000100:00100000:1.0:1787360413.435580:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787360413.435589:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596201472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360413.435615:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787360413.435628:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596201344:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360413.435724:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360413.435740:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596201472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360413.435747:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787360413.435992:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596201472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360413.945476:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596202240:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.945525:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596201984:0@lo:400:kworker.0 00000100:00100000:3.0:1787360413.945551:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.945553:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360413.945696:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202240 00000100:00100000:0.0:1787360413.945704:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202240 00000100:00100000:0.0:1787360413.945780:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360413.945792:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596202240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360413.946320:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201984 00000100:00100000:1.0:1787360413.946326:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201984 00000100:00100000:1.0:1787360413.946361:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787360413.946369:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.951258:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596202496:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.951642:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.951688:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596203008:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.951719:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.951757:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596203520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360413.951783:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.951807:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787360413.951814:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596202112:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.951839:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.951859:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596202624:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.952046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.952071:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596203136:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.952095:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.952113:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596203648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360413.952133:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360413.952172:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360413.952189:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203008 00000100:00100000:2.0:1787360413.952196:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203008 00000100:00100000:2.0:1787360413.952287:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203136 00000100:00100000:2.0:1787360413.952291:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203136 00000100:00100000:2.0:1787360413.952319:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360413.952329:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596203008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.953674:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596203008:12345-0@lo:400:kworker.0 Request processed in 1340us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.953701:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360413.953735:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787360413.953745:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.953781:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596203136:12345-0@lo:400:kworker.0 Request processed in 40us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.953787:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787360413.953818:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203520 00000100:00100000:2.0:1787360413.953824:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203520 00000100:00100000:2.0:1787360413.953850:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203648 00000100:00100000:2.0:1787360413.953854:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203648 00000100:00100000:2.0:1787360413.953868:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360413.953874:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596203520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360413.954021:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360413.954059:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596203520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 185us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.954066:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360413.954078:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787360413.954084:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596203648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360413.954099:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360413.954127:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596203648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.954133:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787360413.954153:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202112 00000100:00100000:2.0:1787360413.954157:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202112 00000100:00100000:2.0:1787360413.954178:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202624 00000100:00100000:2.0:1787360413.954181:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202624 00000100:00100000:2.0:1787360413.954205:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360413.954211:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596202112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954281:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596202112:12345-0@lo:400:kworker.0 Request processed in 70us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.954288:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360413.954300:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360413.954306:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596202624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954335:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596202624:12345-0@lo:400:kworker.0 Request processed in 30us (2454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.954340:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787360413.954587:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360413.954591:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360413.954594:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360413.954596:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360413.954631:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596202112:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954644:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596202624:0@lo:400:kworker.0 00010000:00080000:2.0:1787360413.954658:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b84380 x1874182596203136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360413.954668:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596203136:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954682:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596203648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360413.954696:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596203520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360413.954711:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596203008:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954780:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596201856:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.954832:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.954866:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596201728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360413.955075:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955097:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596202368:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955121:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955137:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596202880:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955155:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955170:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596203392:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955209:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787360413.955214:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596202752:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955287:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955306:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596203264:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955328:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360413.955616:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202368 00000100:00100000:2.0:1787360413.955623:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202368 00000100:00100000:2.0:1787360413.955654:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202880 00000100:00100000:2.0:1787360413.955658:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202880 00000100:00100000:2.0:1787360413.955670:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203392 00000100:00100000:2.0:1787360413.955673:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203392 00000100:00100000:2.0:1787360413.955695:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596203264 00000100:00100000:2.0:1787360413.955698:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596203264 00000100:00100000:2.0:1787360413.955714:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787360413.955721:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596202368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955767:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596202368:12345-0@lo:400:kworker.0 Request processed in 45us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.955786:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787360413.955801:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787360413.955806:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.955835:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596202880:12345-0@lo:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.955840:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787360413.955850:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787360413.955856:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596203392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360413.958517:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596202240:12345-0@lo:400:kworker.0 Request processed in 12720us (12958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360413.958533:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360413.958788:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596203392:12345-0@lo:400:kworker.0 Request processed in 1020us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.958800:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787360413.958822:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202752 00000100:00100000:2.0:1787360413.958824:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787360413.958830:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202752 00000100:00100000:2.0:1787360413.958837:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596203264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360413.958888:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360413.958895:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596202752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.958903:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596203264:12345-0@lo:400:kworker.0 Request processed in 72us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.958910:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787360413.958945:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360413.958950:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360413.958965:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201728 00000100:00100000:2.0:1787360413.958968:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201728 00000100:00100000:2.0:1787360413.958993:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360413.958998:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596201728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360413.959013:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360413.959091:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596202752:12345-0@lo:400:kworker.0 Request processed in 195us (3802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360413.959098:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360413.959152:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596202496 00000100:00100000:0.0:1787360413.959157:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596202496 00000100:00100000:0.0:1787360413.959176:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787360413.959181:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596201728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (4106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360413.959190:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596202496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959195:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787360413.959249:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596202496:12345-0@lo:400:kworker.0 Request processed in 60us (7609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.959255:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596202752:0@lo:400:kworker.0 00000100:00100000:0.0:1787360413.959255:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787360413.959282:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596203264:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959292:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787360413.959297:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596202496:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959310:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596201728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360413.959323:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596202368:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959334:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596202880:0@lo:400:kworker.0 00010000:00080000:2.0:1787360413.959578:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b87480 x1874182596203392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360413.959592:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596203392:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959640:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596201856 00000100:00100000:2.0:1787360413.959645:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596201856 00000100:00100000:2.0:1787360413.959672:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787360413.959678:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3659:x1874182596201856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360413.959679:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596202240:0@lo:400:kworker.0 00000100:00100000:2.0:1787360413.959716:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3659:x1874182596201856:12345-0@lo:400:kworker.0 Request processed in 38us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360413.959722:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787360413.959733:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596201856:0@lo:400:kworker.0 00000100:00100000:1.0:1787360413.963096:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596201984:12345-0@lo:400:kworker.0 Request processed in 16718us (17530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360413.963111:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1787360413.963687:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360413.964399:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596201984:0@lo:400:kworker.0 00000040:00080000:1.0:1787360414.525643:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360414.969919:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787360415.150057:0:25646:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787360415.491070:0:23502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0d96d89d-c68a-4f37-a626-1a4c9be7a00b 00000001:00100000:2.0:1787360415.491091:0:23502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c61ba93f-dce6-49e7-928d-2c5364490956 00000001:00100000:0.0:1787360415.494941:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d96d89d-c68a-4f37-a626-1a4c9be7a00b 00000001:00100000:0.0:1787360415.494962:0:22749:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c61ba93f-dce6-49e7-928d-2c5364490956 00010000:00010000:0.0:1787360415.994457:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360417.021770:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787360417.535870:0:24270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d96d89d-c68a-4f37-a626-1a4c9be7a00b 00000001:00100000:0.0:1787360417.536045:0:25089:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d96d89d-c68a-4f37-a626-1a4c9be7a00b 00000100:00100000:2.0:1787360417.643821:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.643947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.644000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.644033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.644054:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.644075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360417.644086:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120768 00000100:00100000:2.0:1787360417.644092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360417.644099:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120768 00000100:00100000:2.0:1787360417.644110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360417.644129:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360417.644168:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121280 00000100:00100000:0.0:1787360417.644171:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121280 00000100:00100000:0.0:1787360417.644188:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120640 00000100:00100000:0.0:1787360417.644191:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120640 00000100:00100000:0.0:1787360417.644203:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121152 00000100:00100000:0.0:1787360417.644206:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121152 00000100:00100000:2.0:1787360417.644213:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120512 00000100:00100000:2.0:1787360417.644216:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120512 00000100:00100000:0.0:1787360417.644222:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360417.644265:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120768:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360417.644275:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121024 00000100:00100000:2.0:1787360417.644278:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121024 00000100:00100000:2.0:1787360417.644290:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120384 00000100:00100000:2.0:1787360417.644292:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120384 00000100:00100000:2.0:1787360417.644303:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120896 00000100:00100000:2.0:1787360417.644305:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120896 00000100:00100000:2.0:1787360417.644318:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:2.0:1787360417.644324:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120512:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360417.644348:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120768:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644349:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120512:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644356:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:0.0:1787360417.644357:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360417.644373:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:0.0:1787360417.644379:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121280:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360417.644385:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:2.0:1787360417.644391:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121024:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360417.644402:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121280:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644410:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121024:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 19us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644416:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1787360417.644417:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1787360417.644426:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1787360417.644427:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1787360417.644432:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:2402:x1874182575120384:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360417.644433:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120640:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360417.644455:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575120640:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644456:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:2402:x1874182575120384:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360417.644462:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1787360417.644463:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1787360417.644471:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360417.644472:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360417.644477:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121152:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360417.644478:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2402:x1874182575120896:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360417.644497:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2402:x1874182575120896:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360417.644498:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575121152:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360417.644503:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360417.644504:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00080000:2.0:1787360417.644532:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360417.644536:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360417.644539:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360417.644541:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360417.645545:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575120256 00000100:00100000:1.0:1787360417.645558:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575120256 00000100:00100000:1.0:1787360417.645624:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:1.0:1787360417.645634:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:2402:x1874182575120256:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360417.645701:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c298050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:2402:x1874182575120256:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 68us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360417.645709:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 145 00010000:00010000:0.0:1787360418.044777:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787360418.427522:0:25794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4fa641f0 20000000:00000080:2.0:1787360418.427547:0:25794:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a293b5400 uarg=0000000000000000 20000000:01000000:2.0:1787360418.427602:0:25794:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787360418.427608:0:25794:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787360418.427614:0:25794:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787360418.430967:0:25795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787360418.431204:0:25794:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787360418.438655:0:25794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787360418.438696:0:25794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438720:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438728:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438759:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438766:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438777:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438786:0:25794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438795:0:25794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438852:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.438870:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.438959:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596203776:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360418.439091:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 12 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.439101:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 12 pid: 22763 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.439110:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596203904:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360418.439152:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.439161:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 23 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.439172:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204032:0@lo:104: 00000100:00100000:2.0:1787360418.439219:0:25794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360418.439809:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 23 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.439820:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 23 pid: 22764 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.439831:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204160:0@lo:104: 00000100:00100000:1.0:1787360418.439910:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204032 00000100:00100000:1.0:1787360418.439920:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204032 00000100:00100000:1.0:1787360418.439985:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360418.439996:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:25794:x1874182596204032:12345-0@lo:104: 00010000:00010000:1.0:1787360418.440011:0:22752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.442044:0:25794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360418.442134:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.442151:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 23 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.442167:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204288:0@lo:104: 00000100:00100000:2.0:1787360418.442214:0:25794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360418.442270:0:25794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 23 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.442278:0:25794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 23 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.442318:0:25794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204416:0@lo:104: 00000100:00100000:2.0:1787360418.442342:0:25794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360418.442355:0:25794:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba28300 going to sleep for 11 seconds 00000100:00100000:0.0:1787360418.442469:0:22753:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787360418.442480:0:22753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787360418.442774:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204160 00000100:00100000:3.0:1787360418.442782:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204160 00000100:00100000:3.0:1787360418.442828:0:22753:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787360418.442834:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204288 00000100:00100000:3.0:1787360418.442836:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204288 00000100:00100000:3.0:1787360418.442843:0:22753:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787360418.442846:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204416 00000100:00100000:3.0:1787360418.442848:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204416 00000100:00100000:0.0:1787360418.442964:0:25796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360418.442975:0:25796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:25794:x1874182596204160:12345-0@lo:104: 00010000:00010000:0.0:1787360418.442990:0:25796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443051:0:25796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360418.443057:0:25796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+6:25794:x1874182596204160:12345-0@lo:104: Request processed in 84us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360418.443064:0:25796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360418.443081:0:25796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360418.443092:0:25796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:25794:x1874182596204288:12345-0@lo:104: 00010000:00010000:0.0:1787360418.443099:0:25796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443131:0:25796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787360418.443136:0:25796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+5:25794:x1874182596204288:12345-0@lo:104: Request processed in 45us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360418.443141:0:25796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787360418.443157:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360418.443164:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443172:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360418.443177:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443187:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360418.443194:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360418.443199:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360418.443266:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443273:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360418.443301:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443319:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71800/0x359a4e2aee721b84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b8b expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443330:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360418.443334:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443340:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360418.443343:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443349:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360418.443355:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360418.443367:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360418.443381:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443387:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360418.443393:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443400:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35041a00/0x359a4e2aee721b45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b4c expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443408:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.443413:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.443415:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360418.443434:0:25796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787360418.443440:0:25796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:25794:x1874182596204416:12345-0@lo:104: 00010000:00010000:0.0:1787360418.443448:0:25796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443476:0:25796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360418.443481:0:25796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+4:25794:x1874182596204416:12345-0@lo:104: Request processed in 41us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360418.443486:0:25796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787360418.443496:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360418.443499:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443505:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360418.443508:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443515:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360418.443521:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360418.443526:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360418.443540:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443545:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360418.443573:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443580:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee721b37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721b3e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.443589:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.443591:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.443593:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360418.443795:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360418.443811:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596204544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360418.443846:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360418.443894:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360418.443899:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596204672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360418.443917:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360418.443943:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596204800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360418.443961:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360418.443986:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204544 00000100:00100000:3.0:1787360418.443990:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204544 00010000:00010000:3.0:1787360418.444012:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 24 pid: 22764 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360418.444026:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204672 00000100:00100000:3.0:1787360418.444029:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204672 00010000:00010000:3.0:1787360418.444036:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 25 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360418.444044:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204800 00000100:00100000:3.0:1787360418.444046:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204800 00010000:00010000:3.0:1787360418.444061:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 26 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360418.444072:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360418.444077:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+26:3658:x1874182596204544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360418.444087:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360418.444092:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 26 pid: 22764 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444102:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 26 pid: 22764 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444121:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360418.444148:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+26:3658:x1874182596204544:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360418.444155:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360418.444167:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360418.444173:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:3658:x1874182596204672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360418.444180:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360418.444184:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 25 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444193:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 25 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444202:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360418.444222:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:3658:x1874182596204672:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360418.444258:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360418.444275:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360418.444281:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3660:x1874182596204800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360418.444288:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360418.444301:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 24 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444310:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 24 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.444319:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360418.444342:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3660:x1874182596204800:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360418.444347:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360418.444504:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596204800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360418.444530:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596204672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360418.444536:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3658:1874182596204544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360418.444618:0:25794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041c00/0x359a4e2aee721b8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721b84 expref: 23 pid: 22764 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.444632:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204160:0@lo:104: 00010000:00010000:2.0:1787360418.444642:0:25794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71200/0x359a4e2aee721b4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721b45 expref: 22 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.444648:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204288:0@lo:104: 00010000:00010000:2.0:1787360418.444657:0:25794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681400/0x359a4e2aee721b3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721b37 expref: 21 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.444665:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204416:0@lo:104: 00000100:00100000:2.0:1787360418.449735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360418.450408:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596203776:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360418.450422:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596203904:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360418.450750:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121536 00000100:00100000:0.0:1787360418.450760:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121536 00010000:00010000:0.0:1787360418.450816:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 13 pid: 22763 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360418.450865:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1787360418.450877:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:2400:x1874182575121536:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360418.450906:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360418.450914:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 13 pid: 22763 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.450927:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 13 pid: 22763 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.450947:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3e33f800/0x359a4e2aee721e71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5c6 expref: 13 pid: 22763 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.450964:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360418.451031:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:2400:x1874182575121536:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 156us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360418.451040:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00010000:00010000:1.0:1787360418.452153:0:22752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360418.452169:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+3:25794:x1874182596204032:12345-0@lo:104: Request processed in 12170us (12945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360418.452181:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787360418.452313:0:22758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360418.452324:0:22758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.452333:0:22758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360418.452338:0:22758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.452348:0:22758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360418.452355:0:22758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360418.452535:0:22758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360418.452595:0:22758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.452603:0:22758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360418.452628:0:22758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.452635:0:22758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b70a00/0x359a4e2aee721c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721c25 expref: -99 pid: 25088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.452652:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.452654:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360418.452655:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360418.452664:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360418.452683:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596204928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360418.452741:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360418.453282:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596204928 00000100:00100000:2.0:1787360418.453301:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596204928 00010000:00010000:2.0:1787360418.453337:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 21 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.453492:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787360418.453503:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a05d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3660:x1874182596204928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360418.453521:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360418.453528:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 21 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.453551:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 21 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360418.453575:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360418.453639:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a05d1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:3660:x1874182596204928:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360418.453647:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787360418.453733:0:25794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689400/0x359a4e2aee721c25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721c1e expref: 20 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360418.453747:0:25794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25794:1874182596204032:0@lo:104: 00010000:00010000:2.0:1787360418.453798:0:25794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360418.454030:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3660:1874182596204928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360418.454672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360418.454754:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121408 00000100:00100000:3.0:1787360418.454763:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121408 00010000:00010000:3.0:1787360418.454795:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360418.454980:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1787360418.454990:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:2399:x1874182575121408:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360418.455004:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360418.455022:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455034:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455050:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516600/0x359a4e2aee721eb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef636 expref: 12 pid: 22761 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455067:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455076:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455094:0:22756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455102:0:22756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455109:0:22756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455117:0:22756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455124:0:22756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360418.455129:0:22756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455138:0:22756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455170:0:22756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360418.455182:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360418.455281:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:2399:x1874182575121408:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 291us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360418.455290:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00010000:00010000:0.0:1787360418.456001:0:25794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.456015:0:25794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360418.456022:0:25794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697000/0x359a4e2aee721ee1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360418.554523:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596205056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360418.554728:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360418.554859:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360418.554866:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596205184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360418.554878:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205056 00000100:00100000:2.0:1787360418.554887:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205056 00000100:00100000:3.0:1787360418.554897:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360418.554935:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787360418.554945:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596205056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360418.554984:0:22775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787360418.555049:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596205056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360418.555057:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787360418.555083:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205184 00000100:00100000:2.0:1787360418.555087:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205184 00000100:00100000:2.0:1787360418.555124:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360418.555131:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596205184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360418.555164:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787360418.555179:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596205056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360418.555195:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596205184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360418.555201:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360418.555206:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596205184:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360418.555221:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360418.560572:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596205312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360418.560668:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360418.561566:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205312 00000100:00100000:1.0:1787360418.561580:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205312 00000100:00100000:1.0:1787360418.561646:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360418.561658:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596205312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360418.561701:0:23510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360418.561789:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596205312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360418.561797:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360418.562058:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596205312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360419.065870:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596205440:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.065964:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360419.066249:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596205824:0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.066288:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360419.066311:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596206336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.066334:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360419.066349:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596206848:0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.066374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066527:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596205952:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066554:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066575:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596206464:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066599:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066616:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596206976:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066637:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066669:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596205568:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066698:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066720:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596206080:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066743:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066760:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596206592:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066781:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066792:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596207104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360419.066812:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066830:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787360419.066851:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596205696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066873:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066888:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596206208:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066905:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066922:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596206720:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.066945:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360419.066977:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205440 00000100:00100000:2.0:1787360419.066986:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205440 00000100:00100000:3.0:1787360419.067132:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206848 00000100:00100000:3.0:1787360419.067137:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206848 00000100:00100000:3.0:1787360419.067184:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205952 00000100:00100000:3.0:1787360419.067193:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205952 00000100:00100000:3.0:1787360419.067206:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206464 00000100:00100000:3.0:1787360419.067208:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206464 00000100:00100000:3.0:1787360419.067217:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206976 00000100:00100000:3.0:1787360419.067219:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206976 00000100:00100000:3.0:1787360419.067265:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206592 00000100:00100000:3.0:1787360419.067268:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206592 00000100:00100000:3.0:1787360419.067280:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206720 00000100:00100000:3.0:1787360419.067282:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206720 00000100:00100000:3.0:1787360419.067296:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360419.067305:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596206848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.067362:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596206848:12345-0@lo:400:kworker.0 Request processed in 58us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.067370:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360419.067386:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360419.067391:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596205952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068147:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596205952:12345-0@lo:400:kworker.0 Request processed in 29us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068158:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360419.068182:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787360419.068191:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596206464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068291:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596206464:12345-0@lo:400:kworker.0 Request processed in 102us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068298:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787360419.068310:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787360419.068317:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068346:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596206976:12345-0@lo:400:kworker.0 Request processed in 30us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068364:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787360419.068376:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787360419.068382:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596206592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068432:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596206592:12345-0@lo:400:kworker.0 Request processed in 40us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068439:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787360419.068451:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360419.068458:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596206720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068509:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596206720:12345-0@lo:400:kworker.0 Request processed in 52us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068515:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360419.068602:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596206848:0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068658:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205824 00000100:00100000:3.0:1787360419.068663:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205824 00000100:00100000:3.0:1787360419.068698:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206336 00000100:00100000:3.0:1787360419.068700:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206336 00000100:00100000:3.0:1787360419.068712:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205696 00000100:00100000:3.0:1787360419.068715:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205696 00000100:00100000:3.0:1787360419.068725:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206208 00000100:00100000:3.0:1787360419.068728:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206208 00000100:00100000:3.0:1787360419.068738:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360419.068744:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068791:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596205824:12345-0@lo:400:kworker.0 Request processed in 47us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068797:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360419.068807:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360419.068819:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596206336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068848:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596206336:12345-0@lo:400:kworker.0 Request processed in 30us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068853:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360419.068865:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360419.068869:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596205696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068894:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596205696:12345-0@lo:400:kworker.0 Request processed in 25us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068900:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360419.068908:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360419.068913:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360419.068941:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596206208:12345-0@lo:400:kworker.0 Request processed in 28us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.068947:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360419.068967:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596207104 00000100:00100000:3.0:1787360419.068971:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596207104 00000100:00100000:3.0:1787360419.068996:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360419.069001:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596207104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360419.069334:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596207232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360419.069374:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360419.069520:0:24277:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787360419.069530:0:24277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:0.0:1787360419.069551:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360419.069556:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360419.069559:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360419.069562:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360419.069683:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596205696:0@lo:400:kworker.0 00000100:00100000:0.0:1787360419.069696:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596206208:0@lo:400:kworker.0 00010000:00080000:0.0:1787360419.069712:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890432b800 x1874182596206720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360419.069723:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596206720:0@lo:400:kworker.0 00000100:00100000:0.0:1787360419.069736:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596206592:0@lo:400:kworker.0 00000100:00100000:0.0:1787360419.069771:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596205952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360419.069783:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596206464:0@lo:400:kworker.0 00010000:00080000:0.0:1787360419.069796:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904329880 x1874182596206976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360419.069815:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596206976:0@lo:400:kworker.0 00000100:00100000:0.0:1787360419.069847:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596207232 00000100:00100000:0.0:1787360419.069852:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596207232 00000100:00100000:0.0:1787360419.069955:0:25808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360419.069964:0:25808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596207232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360419.069991:0:25808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360419.070219:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787360419.070258:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:3661:x1874182596205440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070323:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:3661:x1874182596205440:12345-0@lo:400:kworker.0 Request processed in 69us (4360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.070331:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787360419.070378:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3661:1874182596205440:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070425:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596205568 00000100:00100000:2.0:1787360419.070429:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596205568 00000100:00100000:2.0:1787360419.070455:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596206080 00000100:00100000:2.0:1787360419.070458:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596206080 00000100:00100000:2.0:1787360419.070472:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787360419.070479:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596205568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070521:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596205568:12345-0@lo:400:kworker.0 Request processed in 43us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.070527:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787360419.070538:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787360419.070544:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070570:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596206080:12345-0@lo:400:kworker.0 Request processed in 27us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.070584:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787360419.070615:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596205568:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070626:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596206080:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070677:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596205824:0@lo:400:kworker.0 00000100:00100000:2.0:1787360419.070689:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596206336:0@lo:400:kworker.0 00000100:00100000:1.0:1787360419.070984:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360419.070998:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360419.071067:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360419.071107:0:24277:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:1.0:1787360419.071115:0:24277:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00000100:00100000:1.0:1787360419.071281:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596207360 00000100:00100000:1.0:1787360419.071286:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596207360 00000100:00100000:1.0:1787360419.071381:0:25809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360419.071390:0:25809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596207360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360419.071407:0:25809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787360419.071457:0:25809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596207360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360419.071464:0:25809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360419.071500:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596207360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360419.071850:0:25808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596207232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1886us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360419.071858:0:25808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360419.071894:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596207232:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787360419.071930:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:3.0:1787360419.073680:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360419.073782:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596207104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4776us (6963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.073793:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787360419.073980:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596207104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360419.593407:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.594643:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121664 00000100:00100000:3.0:1787360419.594662:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121664 00000100:00100000:3.0:1787360419.594900:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360419.594915:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:18696:x1874182575121664:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360419.594959:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360419.594990:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef66e expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595073:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595092:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595107:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595125:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595133:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595140:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595356:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516200/0x359a4e2aee721efd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595365:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516200/0x359a4e2aee721efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595374:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516200/0x359a4e2aee721efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360419.595414:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360419.595425:0:22769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360419.595477:0:22769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516200/0x359a4e2aee721efd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595497:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595504:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595512:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.595519:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517e00 already unused, calling callback (ffffffffc1acf4f0) 00000100:00080000:0.0:1787360419.595557:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360419.596512:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597381:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597404:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:3.0:1787360419.597407:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.597413:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597421:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721eef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597442:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597449:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597476:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597483:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360419.597486:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597493:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597501:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9989025f4500) 00010000:00010000:3.0:1787360419.597504:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.597506:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.597511:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721ef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.598514:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef66e expref: 8 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.599844:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516200/0x359a4e2aee721efd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef66e expref: 7 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.599854:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9989025f4200) 00010000:00010000:3.0:1787360419.599857:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360419.599861:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516200, rc 0) 00000100:00100000:3.0:1787360419.600541:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+7:18696:x1874182575121664:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 5626us (7146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.600572:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:1.0:1787360419.607663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360419.607997:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575121792 00000100:00100000:0.0:1787360419.608009:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575121792 00000100:00100000:0.0:1787360419.608070:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1787360419.608082:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c61ba93f-dce6-49e7-928d-2c5364490956+7:18696:x1874182575121792:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787360419.608190:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c61ba93f-dce6-49e7-928d-2c5364490956+7:18696:x1874182575121792:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 Request processed in 109us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360419.608199:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360419.621138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.622169:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122048 00000100:00100000:3.0:1787360419.622185:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122048 00000100:00100000:3.0:1787360419.622380:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:3.0:1787360419.622393:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+7:18696:x1874182575122048:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360419.622822:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360419.622855:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee721f04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef675 expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.622962:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623000:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623015:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623033:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623041:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623053:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623179:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ec00/0x359a4e2aee721f19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623187:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ec00/0x359a4e2aee721f19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623194:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ec00/0x359a4e2aee721f19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360419.623204:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787360419.623714:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623726:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623733:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623757:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360419.623763:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623771:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623786:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9989025f4200) 00010000:00010000:0.0:1787360419.623789:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360419.623795:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623802:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee721f0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623818:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623825:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623831:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623836:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360419.623839:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623847:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623880:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff998a037dd100) 00010000:00010000:0.0:1787360419.623883:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360419.623886:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.623892:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee721f12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.626483:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee721f04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef675 expref: 10 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.626654:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ec00/0x359a4e2aee721f19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef675 expref: 9 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360419.626664:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a037dd700) 00010000:00010000:0.0:1787360419.626667:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360419.626671:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33ec00, rc 0) 00000100:00100000:0.0:1787360419.626908:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+9:18696:x1874182575122048:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 4512us (5779us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787360419.627974:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360419.636067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.640331:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122176 00000100:00100000:1.0:1787360419.640352:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122176 00000100:00100000:1.0:1787360419.640594:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1787360419.640627:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+9:18696:x1874182575122176:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787360419.640799:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+9:18696:x1874182575122176:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 175us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360419.640808:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1787360419.663619:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360419.664351:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122304 00000100:00100000:2.0:1787360419.664365:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122304 00000100:00100000:2.0:1787360419.664590:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1787360419.664604:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:18696:x1874182575122304:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787360419.664604:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787360419.666104:0:22771:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1443us 00000100:00100000:3.0:1787360419.698271:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+5:18696:x1874182575122304:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 33625us (34620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.698288:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1787360419.711213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.711417:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122432 00000100:00100000:3.0:1787360419.711431:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122432 00000100:00100000:3.0:1787360419.711606:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1787360419.711618:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+9:18702:x1874182575122432:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360419.711641:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360419.711669:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef67c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712027:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712045:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712058:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712079:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712102:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712160:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712217:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712267:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712275:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712282:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360419.712287:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712295:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712309:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:3.0:1787360419.712313:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.712319:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712325:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712341:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712354:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712360:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712366:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360419.712369:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712376:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712384:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:3.0:1787360419.712387:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.712390:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712396:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee721f35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712436:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef67c expref: 10 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712447:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:3.0:1787360419.712449:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.712452:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef67c expref: 10 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.712475:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:3.0:1787360419.712681:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+9:18702:x1874182575122432:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1064us (1483us total) trans 0 rc 301/301 00000100:00100000:3.0:1787360419.712690:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1787360419.721899:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.724763:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122560 00000100:00100000:3.0:1787360419.724786:0:22778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122560 00000100:00100000:3.0:1787360419.724862:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787360419.724875:0:22778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c61ba93f-dce6-49e7-928d-2c5364490956+9:18702:x1874182575122560:12345-192.168.206.11@tcp:700:lfs.0 00000100:00100000:3.0:1787360419.725011:0:22778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c61ba93f-dce6-49e7-928d-2c5364490956+9:18702:x1874182575122560:12345-192.168.206.11@tcp:700:lfs.0 Request processed in 137us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.725020:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1787360419.727498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.727668:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122816 00000100:00100000:1.0:1787360419.727682:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122816 00000100:00100000:1.0:1787360419.727750:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1787360419.727762:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+9:18702:x1874182575122816:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:1.0:1787360419.727833:0:24584:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360419.727868:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee721e9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef5f7 expref: 9 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.727890:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:1.0:1787360419.727897:0:24584:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360419.728049:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.728066:0:24584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.728075:0:24584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.728115:0:24584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 5 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.728153:0:24584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 5 pid: 22771 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360419.728178:0:24584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24584:1874182596207488:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360419.728789:0:24584:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360419.733696:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.733863:0:24584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24584:1874182596207488:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360419.733911:0:24584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360419.734038:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575122944 00000100:00100000:3.0:1787360419.734048:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575122944 00010000:00010000:3.0:1787360419.734131:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 6 pid: 22771 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360419.734178:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:2.0:1787360419.734188:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360419.734189:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2400:x1874182575122944:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360419.734207:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360419.734216:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 6 pid: 22771 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.734347:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 6 pid: 22771 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.734397:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee721eda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef667 expref: 6 pid: 22771 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.734529:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:3.0:1787360419.734534:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.734544:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.734552:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.734635:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360419.734701:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2400:x1874182575122944:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 511us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.734710:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00010000:00010000:3.0:1787360419.735564:0:24584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.735575:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.735605:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.735618:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.735627:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743153:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743183:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743210:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360419.743418:0:24584:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037de6844 reply state 000000002044c5ab transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743434:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743444:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:2.0:1787360419.743447:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360419.743452:0:24584:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787360419.743596:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360419.743608:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743619:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743625:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743634:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360419.743640:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743650:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743667:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3c00) 00010000:00010000:2.0:1787360419.743669:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360419.743683:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.743691:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee721f3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360419.743715:0:24584:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037de6844 reply state 000000002044c5ab transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.744667:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.744678:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:2.0:1787360419.744681:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360419.744686:0:24584:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787360419.744840:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+10:18702:x1874182575122816:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 17074us (17350us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787360419.744850:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1787360419.816839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.817000:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123072 00000100:00100000:3.0:1787360419.817013:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123072 00000100:00100000:3.0:1787360419.817098:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:3.0:1787360419.817110:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+11:18077:x1874182575123072:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360419.817131:0:22761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360419.817157:0:22761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517e00/0x359a4e2aee721f51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef683 expref: -99 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.817193:0:22761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517e00/0x359a4e2aee721f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef683 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.817207:0:22761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517e00/0x359a4e2aee721f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef683 expref: 12 pid: 22761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.817218:0:22761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517e00, rc 0) 00000100:00100000:3.0:1787360419.817835:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123072:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 722us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.817845:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:1.0:1787360419.824336:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360419.824566:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123200 00000100:00100000:2.0:1787360419.824580:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123200 00000100:00100000:2.0:1787360419.825817:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:2.0:1787360419.825839:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123200:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360419.826491:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123200:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 658us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.826501:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:0.0:1787360419.834160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.834270:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123328 00000100:00100000:3.0:1787360419.834282:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123328 00000100:00100000:3.0:1787360419.834348:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00100000:3.0:1787360419.834361:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123328:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360419.834681:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123328:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 321us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.834691:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00100000:3.0:1787360419.846929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360419.847323:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123456 00000100:00100000:2.0:1787360419.847338:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123456 00000100:00100000:2.0:1787360419.847407:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1787360419.847421:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+12:18077:x1874182575123456:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360419.847459:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360419.847482:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697200/0x359a4e2aee721f58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef68a expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.847520:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697200/0x359a4e2aee721f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef68a expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.847533:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697200/0x359a4e2aee721f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef68a expref: 13 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360419.847543:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697200, rc 0) 00000100:00100000:2.0:1787360419.847850:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18077:x1874182575123456:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 431us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.848152:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:1.0:1787360419.854554:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360419.854876:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123584 00000100:00100000:0.0:1787360419.854899:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123584 00000100:00100000:0.0:1787360419.854963:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:0.0:1787360419.854974:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18077:x1874182575123584:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360419.855426:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18077:x1874182575123584:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 453us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360419.855435:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:1.0:1787360419.864579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360419.864872:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123712 00000100:00100000:2.0:1787360419.864890:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123712 00000100:00100000:2.0:1787360419.865037:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:2.0:1787360419.865053:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18077:x1874182575123712:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360419.865278:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:18077:x1874182575123712:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 228us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360419.865287:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:3.0:1787360419.896695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.898265:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123840 00000100:00100000:1.0:1787360419.898279:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123840 00000100:00100000:1.0:1787360419.898348:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787360419.898370:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+10:18711:x1874182575123840:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:1.0:1787360419.898402:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360419.898426:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef691 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898493:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee721f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898506:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee721f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898520:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee721f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360419.898577:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360419.898581:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360419.898617:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee721f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898640:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef691 expref: 12 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898659:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee721f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef691 expref: 11 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.898668:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:1.0:1787360419.898671:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360419.898674:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef000, rc 0) 00000100:00100000:1.0:1787360419.898740:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+11:18711:x1874182575123840:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 381us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360419.898748:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787360419.936338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.936492:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575123968 00000100:00100000:3.0:1787360419.936503:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575123968 00000100:00100000:3.0:1787360419.936583:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:3.0:1787360419.936594:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:18713:x1874182575123968:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360419.936615:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360419.936635:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef698 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.936700:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517c00/0x359a4e2aee721f74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.936714:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517c00/0x359a4e2aee721f74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.937045:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517c00/0x359a4e2aee721f74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360419.937093:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360419.937097:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360419.937120:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517c00/0x359a4e2aee721f74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.937146:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721f6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef698 expref: 7 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.937165:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517c00/0x359a4e2aee721f74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef698 expref: 6 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.937173:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:3.0:1787360419.937176:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360419.937179:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517c00, rc 0) 00000100:00100000:3.0:1787360419.937300:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18713:x1874182575123968:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 707us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360419.937315:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:2.0:1787360419.941221:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.941755:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575124096 00000100:00100000:1.0:1787360419.941765:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575124096 00000100:00100000:1.0:1787360419.944891:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:1.0:1787360419.944918:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:18713:x1874182575124096:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360419.944944:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360419.944966:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef69f expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945031:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945061:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945073:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945087:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945095:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.945101:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946038:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946052:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946062:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360419.946101:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360419.946104:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360419.946127:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946139:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946158:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946166:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946183:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360419.946189:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946196:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946208:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:1.0:1787360419.946211:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360419.946215:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946262:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee721f82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946277:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946283:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946288:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946292:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360419.946301:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946306:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946323:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:1.0:1787360419.946326:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360419.946329:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946335:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721f89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946365:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef69f expref: 8 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946377:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef69f expref: 7 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.946384:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:1.0:1787360419.946387:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360419.946389:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef400, rc 0) 00000100:00100000:1.0:1787360419.946484:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+7:18713:x1874182575124096:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1579us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360419.946503:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1787360419.950524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360419.958066:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575124224 00000100:00100000:0.0:1787360419.958081:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575124224 00000100:00100000:0.0:1787360419.958271:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:0.0:1787360419.958282:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:18713:x1874182575124224:12345-192.168.206.11@tcp:900:lfs.0 00000100:00100000:0.0:1787360419.958379:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:18713:x1874182575124224:12345-192.168.206.11@tcp:900:lfs.0 Request processed in 98us (7880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360419.958387:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00080000:2.0:1787360419.960523:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360419.970418:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360419.970517:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575124480 00000100:00100000:1.0:1787360419.970527:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575124480 00000100:00100000:1.0:1787360419.970585:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:1.0:1787360419.970596:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+7:18713:x1874182575124480:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360419.970633:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360419.970655:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6a6 expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360419.970767:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787360419.970871:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6a6 expref: 9 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.970996:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:1.0:1787360419.970999:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360419.971005:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6a6 expref: 9 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360419.971021:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeec00, rc 0) 00000100:00100000:1.0:1787360419.971294:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+8:18713:x1874182575124480:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 697us (882us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787360419.971301:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:0.0:1787360419.986074:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.987133:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575124736 00000100:00100000:3.0:1787360419.987147:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575124736 00000100:00100000:3.0:1787360419.987216:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1787360419.987285:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+8:18713:x1874182575124736:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:3.0:1787360419.987343:0:22769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360419.987373:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee721f90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef69f expref: 8 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.987393:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:3.0:1787360419.987398:0:22769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360419.987420:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.987434:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.987444:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360419.987673:0:22769:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000345766b3 reply state 000000000f1d9d79 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.987687:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.987693:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:3.0:1787360419.987696:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787360419.987699:0:22769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787360419.987713:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787360419.987799:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+9:18713:x1874182575124736:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 517us (1732us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787360419.987807:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1787360419.991796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360419.991908:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575124992 00000100:00100000:0.0:1787360419.991919:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575124992 00000100:00100000:0.0:1787360419.991977:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1787360419.991987:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+9:18713:x1874182575124992:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1787360419.992270:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+10:18713:x1874182575124992:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 284us (483us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787360419.992280:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1787360419.995048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360419.995158:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575125248 00000100:00100000:3.0:1787360419.995167:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575125248 00000100:00100000:3.0:1787360419.995272:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:3.0:1787360419.995282:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+10:18713:x1874182575125248:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360419.995309:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360419.995330:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee721fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6ad expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995410:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995424:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995434:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995445:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995452:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995458:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360419.995565:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787360419.995646:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995654:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995660:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995667:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360419.995671:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995678:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995691:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:3.0:1787360419.995694:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.995699:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995704:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995719:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995725:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995732:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995748:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360419.995751:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995757:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995766:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:3.0:1787360419.995769:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360419.995772:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995778:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995810:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee721fac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ad expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995821:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:3.0:1787360419.995823:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360419.995827:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee721fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ad expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360419.995836:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:3.0:1787360419.995900:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+11:18713:x1874182575125248:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 619us (862us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1787360419.995908:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:2.0:1787360420.000672:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.000998:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575125376 00000100:00100000:3.0:1787360420.001021:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575125376 00000100:00100000:3.0:1787360420.001128:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:3.0:1787360420.001139:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+11:18713:x1874182575125376:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360420.001166:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360420.001187:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721fc8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6b4 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001330:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001345:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001356:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360420.001379:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360420.001383:0:22769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360420.001400:0:22769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001424:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721fc8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 13 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001444:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.001452:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:3.0:1787360420.001455:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360420.001458:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040a00, rc 0) 00000100:00100000:3.0:1787360420.001526:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+12:18713:x1874182575125376:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 388us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360420.001533:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787360420.007974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360420.008112:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575125504 00000100:00100000:0.0:1787360420.008124:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575125504 00000100:00100000:0.0:1787360420.008182:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360420.008193:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+12:18713:x1874182575125504:12345-192.168.206.11@tcp:37:lfs.0 00000100:00100000:0.0:1787360420.014425:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+12:18713:x1874182575125504:12345-192.168.206.11@tcp:37:lfs.0 Request processed in 6225us (6451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360420.014439:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360420.019220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.019481:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575125760 00000100:00100000:3.0:1787360420.019491:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575125760 00000100:00100000:3.0:1787360420.019545:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1787360420.019555:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eec2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+12:18713:x1874182575125760:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360420.019767:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eec2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+13:18713:x1874182575125760:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 213us (556us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787360420.019776:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00010000:00010000:0.0:1787360420.089957:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360420.107035:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.107169:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575125888 00000100:00100000:3.0:1787360420.107179:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575125888 00000100:00100000:3.0:1787360420.107301:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1787360420.107639:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+11:18719:x1874182575125888:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360420.107664:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360420.107687:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6bb expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107753:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107769:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107779:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107789:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107812:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.107820:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.110877:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696c00/0x359a4e2aee721feb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.110899:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696c00/0x359a4e2aee721feb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.110910:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696c00/0x359a4e2aee721feb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360420.110948:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787360420.110952:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360420.110992:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696c00/0x359a4e2aee721feb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111015:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111021:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111028:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111033:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360420.111037:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111044:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111071:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:2.0:1787360420.111073:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360420.111078:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111085:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111321:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111329:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111334:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111339:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360420.111342:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111347:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111356:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:2.0:1787360420.111359:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360420.111362:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111367:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee721fe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111414:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6bb expref: 13 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111427:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696c00/0x359a4e2aee721feb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6bb expref: 12 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.111434:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:2.0:1787360420.111436:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787360420.111439:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696c00, rc 0) 00000100:00100000:2.0:1787360420.111520:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+12:18719:x1874182575125888:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4209us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.111529:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:2.0:1787360420.116625:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360420.116726:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575126016 00000100:00100000:0.0:1787360420.116737:0:22780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575126016 00000100:00100000:0.0:1787360420.116806:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360420.116819:0:22780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c61ba93f-dce6-49e7-928d-2c5364490956+5:18719:x1874182575126016:12345-192.168.206.11@tcp:900:bash.0 00000100:00100000:0.0:1787360420.116921:0:22780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c61ba93f-dce6-49e7-928d-2c5364490956+5:18719:x1874182575126016:12345-192.168.206.11@tcp:900:bash.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360420.116929:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360420.119569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360420.119649:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575126272 00000100:00100000:1.0:1787360420.119659:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575126272 00000100:00100000:1.0:1787360420.119712:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:1.0:1787360420.119720:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+12:18719:x1874182575126272:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360420.119741:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360420.119761:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721ff2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6c2 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.119886:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.119926:0:22770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.119936:0:22770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.119980:0:22770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 12 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.119993:0:22770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 12 pid: 22769 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.120017:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1874182596207616:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360420.120101:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787360420.125111:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1874182596207616:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360420.125143:0:22770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360420.126364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.126446:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575126400 00000100:00100000:3.0:1787360420.126455:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575126400 00010000:00010000:3.0:1787360420.126494:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 13 pid: 22769 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360420.126537:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1787360420.126548:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+13:2400:x1874182575126400:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360420.126562:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360420.126569:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 13 pid: 22769 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126583:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 13 pid: 22769 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126609:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee721fcf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6b4 expref: 13 pid: 22769 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126626:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:3.0:1787360420.126632:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126642:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126665:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.126697:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360420.126763:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+12:2400:x1874182575126400:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 216us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360420.126770:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00010000:00010000:1.0:1787360420.126946:0:22770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.126955:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.126981:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.126991:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.127005:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128692:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128712:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128722:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360420.128733:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787360420.128759:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128766:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128774:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128780:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360420.128784:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.128792:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129048:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:1.0:1787360420.129052:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360420.129069:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129076:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee721ff9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360420.129091:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8a3754c reply state 00000000515c2824 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129103:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129110:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998a28ed3600) 00010000:00010000:1.0:1787360420.129112:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360420.129114:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787360420.129150:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee721ff2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 15 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129165:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 14 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.129172:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.129174:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787360420.129176:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:1.0:1787360420.129343:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+15:18719:x1874182575126272:12345-192.168.206.11@tcp:101:bash.0 Request processed in 9621us (9781us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787360420.129352:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:0.0:1787360420.151692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360420.151784:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575126528 00000100:00100000:1.0:1787360420.151796:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575126528 00000100:00100000:1.0:1787360420.151863:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:1.0:1787360420.151873:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+15:18719:x1874182575126528:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360420.151936:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360420.151957:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee722015 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6c9 expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152027:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152041:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152052:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360420.152104:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787360420.152109:0:24584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360420.152128:0:24584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152139:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152165:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee722015 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c9 expref: 17 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152183:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c9 expref: 16 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.152191:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.152194:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360420.152198:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee200, rc 0) 00000100:00100000:1.0:1787360420.152328:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+16:18719:x1874182575126528:12345-192.168.206.11@tcp:101:bash.0 Request processed in 456us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.152336:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:2.0:1787360420.157850:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.158052:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575126784 00000100:00100000:3.0:1787360420.158065:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575126784 00000100:00100000:3.0:1787360420.158128:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1787360420.158139:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+16:18719:x1874182575126784:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:3.0:1787360420.158474:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+17:18719:x1874182575126784:12345-192.168.206.11@tcp:35:bash.0 Request processed in 337us (633us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1787360420.158483:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1787360420.270792:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.270914:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575127040 00000100:00100000:2.0:1787360420.270924:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575127040 00000100:00100000:2.0:1787360420.270993:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:2.0:1787360420.271004:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+17:18729:x1874182575127040:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360420.271032:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360420.271054:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6d0 expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360420.271162:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360420.271309:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722023 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6d0 expref: 19 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.271346:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:2.0:1787360420.271349:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360420.271356:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6d0 expref: 19 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.271370:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697c00, rc 0) 00000100:00100000:2.0:1787360420.271439:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+18:18729:x1874182575127040:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 436us (658us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1787360420.271447:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1787360420.285903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.286010:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575127296 00000100:00100000:2.0:1787360420.286020:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575127296 00000100:00100000:2.0:1787360420.286079:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1787360420.286089:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+18:18729:x1874182575127296:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360420.286371:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+19:18729:x1874182575127296:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 282us (476us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1787360420.286387:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 10000000:01000000:1.0:1787360420.346590:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787360420.346600:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3c2bf800 from 13 10000000:01000000:1.0:1787360420.346605:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360420.346656:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.346668:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.346680:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.346710:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596207744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.346784:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.346835:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360420.347109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360420.347264:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575127552 00000100:00100000:1.0:1787360420.347272:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575127552 00000100:00100000:1.0:1787360420.347328:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:1.0:1787360420.347337:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+19:18732:x1874182575127552:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360420.347358:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360420.347373:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee722038 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6d7 expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360420.347545:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596207744 00000100:00100000:0.0:1787360420.347551:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596207744 00010000:00010000:1.0:1787360420.347608:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72203f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.347622:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72203f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.347647:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72203f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360420.347661:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1787360420.347662:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787360420.347674:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+20:22767:x1874182596207744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360420.347684:0:22764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360420.347697:0:22764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3e33e600/0x359a4e2aee72204d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee722031 expref: -99 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.347717:0:22764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3e33e600/0x359a4e2aee72204d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee722031 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.347755:0:22764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3e33e600/0x359a4e2aee72204d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee722031 expref: 21 pid: 22764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.347765:0:22764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33e600, rc 0) 00010000:00010000:1.0:1787360420.347789:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee722038 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6d7 expref: 22 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.347808:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72203f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6d7 expref: 21 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.347817:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.347820:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360420.347823:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee600, rc 0) 00000100:00100000:1.0:1787360420.347868:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+21:18732:x1874182575127552:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 532us (761us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1787360420.347876:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1787360420.348133:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596207744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360420.348150:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72204d expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.348159:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72204d expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360420.348263:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596207872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360420.348295:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360420.348325:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360420.348426:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596207872 00000100:00100000:2.0:1787360420.348431:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596207872 00000100:00100000:2.0:1787360420.348570:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787360420.348581:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596207872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.348699:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596207872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360420.351274:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:22767:x1874182596207744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.351632:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596207872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.351809:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.351880:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.351910:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360420.352215:0:22761:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1787360420.352246:0:22761:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1787360420.352346:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.352350:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208000 00000100:00100000:3.0:1787360420.352357:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208000 00000100:00100000:1.0:1787360420.352383:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360420.352535:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575127808 00000100:00100000:1.0:1787360420.352540:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575127808 00000100:00100000:1.0:1787360420.352586:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:1.0:1787360420.352595:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c61ba93f-dce6-49e7-928d-2c5364490956+21:2399:x1874182575127808:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360420.352615:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360420.352640:0:22755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72203f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6d7 expref: 21 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360420.352654:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:1.0:1787360420.352661:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.352681:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360420.352694:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575127680 00000100:00100000:2.0:1787360420.352705:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575127680 00000100:00100000:1.0:1787360420.352724:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c61ba93f-dce6-49e7-928d-2c5364490956+21:2399:x1874182575127808:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 128us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.352730:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787360420.352780:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787360420.352788:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.353631:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:2.0:1787360420.353643:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+20:18732:x1874182575127680:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:2.0:1787360420.353700:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353717:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353740:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353776:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353783:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353791:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353797:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360420.353802:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.353810:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.354157:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360420.354162:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360420.354167:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.354189:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee722054 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360420.354262:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+20:18732:x1874182575127680:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 621us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.354270:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:0.0:1787360420.354386:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787360420.354511:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c299850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1723us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360420.354522:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787360420.357151:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.357426:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575128064 00000100:00100000:2.0:1787360420.357436:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575128064 00000100:00100000:2.0:1787360420.357500:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1787360420.357511:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+20:18732:x1874182575128064:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360420.357710:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+21:18732:x1874182575128064:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 200us (567us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787360420.357718:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360420.360996:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360420.363553:0:25812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360420.363835:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360420.363865:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360420.363887:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72204d expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.363898:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee722031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72204d expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360420.363908:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360420.363911:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9989037da800 from 13 10000000:01000000:3.0:1787360420.363914:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360420.363950:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.363958:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360420.363969:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360420.364008:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360420.364075:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360420.364181:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360420.364682:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208128 00000100:00100000:2.0:1787360420.364691:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208128 00000100:00100000:2.0:1787360420.365083:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787360420.365094:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+21:22767:x1874182596208128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360420.365109:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360420.365124:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697c00/0x359a4e2aee722062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72205b expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.365148:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697c00/0x359a4e2aee722062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72205b expref: 22 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.365158:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697c00/0x359a4e2aee722062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72205b expref: 22 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.365181:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697c00, rc 0) 00000100:00100000:2.0:1787360420.365272:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c29b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.365279:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360420.365366:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360420.365383:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722062 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.365392:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee722062 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.365457:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.365499:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.376354:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360420.378977:0:25811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208256 00000100:00100000:3.0:1787360420.378993:0:25811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208256 00000100:00100000:3.0:1787360420.379077:0:25811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787360420.379088:0:25811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360420.379290:0:25811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (13789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360420.379298:0:25811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787360420.379442:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.379505:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.379560:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360420.379666:0:25811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208384 00000100:00100000:3.0:1787360420.379670:0:25811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208384 00000100:00100000:3.0:1787360420.379694:0:25811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787360420.379702:0:25811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360420.379785:0:25811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360420.379792:0:25811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787360420.381376:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787360420.381410:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360420.382563:0:25813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787360420.382630:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787360420.382650:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360420.382660:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722062 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.382671:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72205b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722062 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360420.382682:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787360420.382684:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a2f244000 from 13 10000000:01000000:1.0:1787360420.382686:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360420.382770:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.382779:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.382789:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.382809:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.382860:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.382951:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360420.385968:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208512 00000100:00100000:2.0:1787360420.385984:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208512 00000100:00100000:2.0:1787360420.386081:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787360420.386093:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+22:22767:x1874182596208512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360420.386112:0:22763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360420.386131:0:22763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696800/0x359a4e2aee722070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee722069 expref: -99 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.386159:0:22763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696800/0x359a4e2aee722070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee722069 expref: 23 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.386169:0:22763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696800/0x359a4e2aee722070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee722069 expref: 23 pid: 22763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.386178:0:22763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696800, rc 0) 00000100:00100000:2.0:1787360420.386280:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.386287:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787360420.386412:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360420.386430:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722070 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.386460:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee722070 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.386543:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.386575:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.386610:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787360420.386712:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208640 00000100:00100000:2.0:1787360420.386727:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208640 00000100:00100000:2.0:1787360420.386759:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787360420.386767:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.386870:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.386897:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787360420.387144:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.387175:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.387214:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360420.387279:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9b4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360420.387293:0:25811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208768 00000100:00100000:1.0:1787360420.387297:0:25811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208768 00000100:00100000:1.0:1787360420.387322:0:25811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787360420.387328:0:25811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.387412:0:25811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.387418:0:25811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787360420.387454:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360420.388395:0:25814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787360420.388466:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787360420.389042:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360420.389054:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722070 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.389067:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee722069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee722070 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360420.389649:0:22767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787360420.389654:0:22767:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a05a04000 from 13 10000000:01000000:0.0:1787360420.389659:0:22767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360420.389700:0:22767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.389710:0:22767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.389791:0:22767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360420.389816:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360420.390394:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360420.390441:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360420.390505:0:25811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596208896 00000100:00100000:1.0:1787360420.390513:0:25811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596208896 00000100:00100000:1.0:1787360420.390565:0:25811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787360420.390575:0:25811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+23:22767:x1874182596208896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360420.390590:0:25811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360420.390604:0:25811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caef400/0x359a4e2aee72207e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee722077 expref: -99 pid: 25811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.390627:0:25811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef400/0x359a4e2aee72207e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee722077 expref: 24 pid: 25811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.390637:0:25811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caef400/0x359a4e2aee72207e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee722077 expref: 24 pid: 25811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.390646:0:25811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef400, rc 0) 00000100:00100000:1.0:1787360420.390699:0:25811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596208896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.390706:0:25811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787360420.390966:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596208896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360420.390982:0:22767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72207e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.390991:0:22767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72207e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360420.391080:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596209024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.391111:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360420.391132:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360420.391304:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596209024 00000100:00100000:1.0:1787360420.391308:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596209024 00000100:00100000:1.0:1787360420.391341:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787360420.391350:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596209024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360420.391461:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:22767:x1874182596209024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.391556:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596209024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.391584:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596209152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.391622:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360420.391644:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360420.391658:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596209152 00000100:00100000:2.0:1787360420.391661:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596209152 00000100:00100000:2.0:1787360420.391680:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787360420.391687:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:22767:x1874182596209152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360420.391774:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+25:22767:x1874182596209152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.391781:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787360420.391816:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:22767:1874182596209152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787360420.392531:0:25815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787360420.392600:0:22767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787360420.392616:0:22767:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360420.392626:0:22767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72207e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.392636:0:22767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3e33e200/0x359a4e2aee722077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72207e expref: -99 pid: 22767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360420.393252:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000040:00080000:0.0:1787360420.477102:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787360420.666753:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360420.843011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360420.843064:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575128320 00000100:00100000:0.0:1787360420.843081:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575128320 00000100:00100000:0.0:1787360420.844270:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1787360420.844296:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+21:18763:x1874182575128320:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:0.0:1787360420.844328:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360420.844358:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722085 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6de expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.844801:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee72208c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.844820:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee72208c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.844854:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee72208c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360420.844868:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360420.845022:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722085 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6de expref: 24 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.845045:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee72208c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6de expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360420.845056:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360420.845059:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360420.845063:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33ee00, rc 0) 00000100:00100000:0.0:1787360420.845162:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+23:18763:x1874182575128320:12345-192.168.206.11@tcp:101:cat.0 Request processed in 878us (2160us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787360420.845171:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1787360420.849517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.849629:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575128448 00000100:00100000:2.0:1787360420.849640:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575128448 00000100:00100000:2.0:1787360420.849840:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:2.0:1787360420.849851:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+23:2399:x1874182575128448:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360420.849866:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360420.849901:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee72208c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6de expref: 23 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.849924:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360420.849929:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360420.849991:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+22:2399:x1874182575128448:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 141us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.850003:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1787360420.856200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.856331:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575128704 00000100:00100000:2.0:1787360420.856346:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575128704 00000100:00100000:2.0:1787360420.856605:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1787360420.856622:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+22:18763:x1874182575128704:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:2.0:1787360420.857194:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+23:18763:x1874182575128704:12345-192.168.206.11@tcp:35:cat.0 Request processed in 578us (1005us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1787360420.857217:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1787360420.960188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360420.960701:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575128960 00000100:00100000:1.0:1787360420.960743:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575128960 00000100:00100000:1.0:1787360420.960812:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360420.960833:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+23:18769:x1874182575128960:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:1.0:1787360420.960861:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360420.960892:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72209a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6e5 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.960995:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.961009:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.961020:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360420.961032:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787360420.961575:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee72209a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6e5 expref: 26 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.961598:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6e5 expref: 25 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.961606:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.961609:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360420.961613:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeee00, rc 0) 00000100:00100000:1.0:1787360420.961679:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+25:18769:x1874182575128960:12345-192.168.206.11@tcp:101:dd.0 Request processed in 856us (1568us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787360420.961687:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1787360420.972937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360420.973041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.973373:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575129216 00000100:00100000:2.0:1787360420.973383:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575129216 00000100:00100000:2.0:1787360420.973446:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1787360420.973458:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+25:18769:x1874182575129216:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1787360420.973484:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360420.973506:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee7220af lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6ec expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973539:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973553:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973564:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973691:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee7220af lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 27 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973711:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 26 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.973734:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360420.973737:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360420.973740:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787360420.973804:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+26:18769:x1874182575129216:12345-192.168.206.11@tcp:101:dd.0 Request processed in 348us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360420.973818:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1787360420.977462:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575129088 00000100:00100000:1.0:1787360420.977479:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575129088 00000100:00100000:1.0:1787360420.977565:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:1.0:1787360420.977575:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+26:2401:x1874182575129088:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360420.977592:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360420.977619:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6e5 expref: 26 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360420.977641:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360420.977646:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360420.977726:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+25:2401:x1874182575129088:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 138us (4784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360420.977735:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:3.0:1787360420.980648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360420.982440:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575129472 00000100:00100000:2.0:1787360420.982453:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575129472 00000100:00100000:2.0:1787360420.982531:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:2.0:1787360420.982543:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+25:18769:x1874182575129472:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:2.0:1787360420.982595:0:22769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360420.982625:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee72201c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c9 expref: 25 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.982648:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360420.982653:0:22769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360420.982832:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.982845:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.982855:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360420.983397:0:22769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1787360420.983427:0:22769:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012d7bd81 reply state 0000000063e2a036 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.983440:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360420.983448:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360420.983450:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360420.983466:0:22769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360420.983572:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+27:18769:x1874182575129472:12345-192.168.206.11@tcp:36:dd.0 Request processed in 1031us (2932us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1787360420.983580:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000020:00080000:2.0:1787360420.983585:0:22769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787360421.083552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360421.084002:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575129728 00000100:00100000:0.0:1787360421.084015:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575129728 00000100:00100000:0.0:1787360421.084086:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1787360421.084098:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+27:18769:x1874182575129728:12345-192.168.206.11@tcp:35:dd.0 00000100:00080000:2.0:1787360421.084392:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360421.084788:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+28:18769:x1874182575129728:12345-192.168.206.11@tcp:35:dd.0 Request processed in 692us (1244us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1787360421.084797:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00010000:00010000:3.0:1787360421.113665:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360421.335726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360421.336060:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575129856 00000100:00100000:0.0:1787360421.336070:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575129856 00000100:00100000:0.0:1787360421.336130:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:0.0:1787360421.336140:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+28:18783:x1874182575129856:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:0.0:1787360421.336182:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360421.336201:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7220c4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6f3 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336309:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336324:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336335:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336345:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336351:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336357:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336611:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336620:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336627:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360421.336668:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787360421.336678:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360421.336714:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336725:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336733:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336739:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336746:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.336752:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360421.336756:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337031:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337048:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:0.0:1787360421.337051:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360421.337055:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337062:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee7220cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337078:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337095:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337102:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337106:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360421.337109:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337115:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337122:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998a28ed3600) 00010000:00010000:0.0:1787360421.337124:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360421.337126:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337133:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7220d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337160:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7220c4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6f3 expref: 30 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337171:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6f3 expref: 29 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.337178:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360421.337181:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360421.337187:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f800, rc 0) 00000100:00100000:0.0:1787360421.337630:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+29:18783:x1874182575129856:12345-192.168.206.11@tcp:101:stat.0 Request processed in 1489us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360421.337640:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1787360421.425284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360421.429086:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575130112 00000100:00100000:1.0:1787360421.429101:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575130112 00000100:00100000:1.0:1787360421.429182:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1787360421.429193:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+29:18789:x1874182575130112:12345-192.168.206.11@tcp:36:truncate.0 00010000:00010000:1.0:1787360421.429294:0:22770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360421.429322:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f800/0x359a4e2aee7220d9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6f3 expref: 29 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.429344:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.429350:0:22770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360421.429539:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.429555:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.429578:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360421.429618:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1787360421.429638:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006627a12b reply state 00000000664c70e1 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.429649:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.429655:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.429658:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360421.429661:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360421.429802:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+31:18789:x1874182575130112:12345-192.168.206.11@tcp:36:truncate.0 Request processed in 610us (4528us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1787360421.429809:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000020:00080000:1.0:1787360421.429815:0:22770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787360421.498531:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787360421.638280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360421.638440:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575130240 00000100:00100000:2.0:1787360421.638450:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575130240 00000100:00100000:2.0:1787360421.638512:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:2.0:1787360421.638523:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+31:18803:x1874182575130240:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:2.0:1787360421.638549:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360421.638568:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee7220e7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef6fa expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638632:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638647:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638657:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638667:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638674:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638680:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638769:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638778:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638785:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360421.638824:0:24584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787360421.638828:0:24584:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360421.638849:0:24584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638860:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638887:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638894:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638900:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638906:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360421.638909:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638916:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638934:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:2.0:1787360421.638937:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360421.638941:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638947:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee7220ee lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638958:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638964:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638971:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638976:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360421.638979:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638985:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.638993:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998a28ed3600) 00010000:00010000:2.0:1787360421.638995:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360421.638998:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.639003:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee7220f5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.639041:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee7220e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 33 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.639055:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 32 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.639063:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360421.639065:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360421.639067:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696200, rc 0) 00000100:00100000:2.0:1787360421.639140:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+32:18803:x1874182575130240:12345-192.168.206.11@tcp:101:stat.0 Request processed in 618us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360421.639148:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:3.0:1787360421.736412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360421.736593:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575130496 00000100:00100000:1.0:1787360421.736603:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575130496 00000100:00100000:1.0:1787360421.736664:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:1.0:1787360421.736675:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+32:18813:x1874182575130496:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360421.736696:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360421.736714:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef701 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360421.736803:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787360421.736919:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722103 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef701 expref: 34 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.736956:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:1.0:1787360421.736959:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360421.736965:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef701 expref: 34 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.736981:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee600, rc 0) 00000100:00100000:1.0:1787360421.737058:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+33:18813:x1874182575130496:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 384us (655us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1787360421.737066:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1787360421.742216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360421.742395:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575130752 00000100:00100000:2.0:1787360421.742417:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575130752 00000100:00100000:2.0:1787360421.742487:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360421.742498:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eec2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+33:18813:x1874182575130752:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360421.742718:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eec2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+34:18813:x1874182575130752:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 221us (511us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1787360421.742726:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360421.819904:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360421.820063:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131008 00000100:00100000:0.0:1787360421.820074:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131008 00000100:00100000:0.0:1787360421.820140:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360421.820150:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+34:18819:x1874182575131008:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360421.820187:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360421.820208:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee722111 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef708 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820353:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820369:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820379:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 35 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820388:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820423:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 35 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820435:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 35 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360421.820464:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596209280:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360421.820557:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.820567:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360421.820576:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596209408:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360421.820599:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360421.825207:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596209280:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360421.825358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360421.825408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360421.825534:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596209408:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360421.825559:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360421.827985:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131136 00000100:00100000:1.0:1787360421.827998:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131136 00010000:00010000:1.0:1787360421.828057:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 36 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360421.828106:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131264 00000100:00100000:1.0:1787360421.828110:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131264 00010000:00010000:1.0:1787360421.828123:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 37 pid: 22770 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360421.828141:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360421.828150:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a05d19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+37:2399:x1874182575131136:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360421.828166:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360421.828172:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 37 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828185:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 37 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828256:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee7220fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6fa expref: 37 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828274:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.828279:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828287:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828293:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360421.828352:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a05d19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+36:2399:x1874182575131136:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 202us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360421.828359:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360421.828409:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:1.0:1787360421.828416:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+35:2399:x1874182575131264:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360421.828423:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360421.828427:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828437:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828449:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee722007 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6c2 expref: 35 pid: 22770 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828482:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.828486:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828493:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828500:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.828521:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360421.828542:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+34:2399:x1874182575131264:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 126us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360421.828549:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00010000:00010000:0.0:1787360421.829299:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.829312:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360421.829334:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787360421.829483:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee722111 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 35 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.829503:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 34 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.829520:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360421.829524:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360421.829527:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f200, rc 0) 00000100:00100000:0.0:1787360421.829566:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+34:18819:x1874182575131008:12345-192.168.206.11@tcp:101:bash.0 Request processed in 9417us (9677us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1787360421.829574:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1787360421.834176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360421.834337:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131520 00000100:00100000:1.0:1787360421.834348:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131520 00000100:00100000:1.0:1787360421.834409:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1787360421.834420:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+34:18819:x1874182575131520:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:1.0:1787360421.834683:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.834700:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.834712:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360421.834765:0:22770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1787360421.834786:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010294552 reply state 00000000c5530d32 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.834808:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.834815:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.834818:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360421.834821:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360421.834905:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+37:18819:x1874182575131520:12345-192.168.206.11@tcp:36:bash.0 Request processed in 486us (740us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1787360421.834913:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000020:00080000:1.0:1787360421.834917:0:22770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787360421.842387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360421.842458:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131648 00000100:00100000:2.0:1787360421.842469:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131648 00000100:00100000:2.0:1787360421.842528:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360421.842540:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+37:18819:x1874182575131648:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360421.842569:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360421.842591:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee72212d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef70f expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.842671:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee72212d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef70f expref: 38 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.842686:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee72212d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef70f expref: 38 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.842706:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360421.842709:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360421.842713:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697800, rc 0) 00000100:00100000:2.0:1787360421.842775:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+38:18819:x1874182575131648:12345-192.168.206.11@tcp:101:bash.0 Request processed in 237us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360421.842782:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1787360421.848686:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360421.849145:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131776 00000100:00100000:3.0:1787360421.849156:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131776 00000100:00100000:3.0:1787360421.849266:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1787360421.849278:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+38:18819:x1874182575131776:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360421.849301:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360421.849324:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee722134 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef716 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360421.849626:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360421.849643:0:22770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 39 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360421.849653:0:22770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360421.849684:0:22770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 39 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360421.849712:0:22770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 39 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360421.849725:0:22770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1874182596209536:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360421.849851:0:22770:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360421.857213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360421.857453:0:22770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22770:1874182596209536:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360421.857493:0:22770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360421.861673:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575131904 00000100:00100000:0.0:1787360421.861690:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575131904 00010000:00010000:0.0:1787360421.862251:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 40 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360421.862303:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360421.862314:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+40:2399:x1874182575131904:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360421.862333:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360421.862339:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 40 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862353:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 40 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862376:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722118 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef708 expref: 40 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862395:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360421.862401:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862426:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862434:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.862614:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360421.862745:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+39:2399:x1874182575131904:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 432us (5542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360421.862753:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00010000:00010000:1.0:1787360421.862983:0:22770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.862993:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360421.863057:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787360421.863062:0:22770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360421.863082:0:22770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.863112:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee722134 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef716 expref: 39 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.863143:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef716 expref: 38 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360421.863151:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360421.863154:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360421.863156:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040e00, rc 0) 00000100:00100000:1.0:1787360421.863186:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+38:18819:x1874182575131776:12345-192.168.206.11@tcp:101:bash.0 Request processed in 13912us (14512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360421.863193:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1787360421.870178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360421.871558:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132160 00000100:00100000:2.0:1787360421.871573:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132160 00000100:00100000:2.0:1787360421.871659:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360421.871671:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+38:18819:x1874182575132160:12345-192.168.206.11@tcp:103:bash.0 00010000:00010000:2.0:1787360421.871688:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787360421.871717:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee72212d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef70f expref: 38 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.871743:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72213b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef716 expref: 37 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.871756:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360421.871761:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360421.871853:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+36:18819:x1874182575132160:12345-192.168.206.11@tcp:103:bash.0 Request processed in 183us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360421.871861:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360421.874071:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360421.874194:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132288 00000100:00100000:0.0:1787360421.874203:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132288 00000100:00100000:0.0:1787360421.874293:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:0.0:1787360421.874302:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+36:18819:x1874182575132288:12345-192.168.206.11@tcp:58:bash.0 00010000:00010000:0.0:1787360421.874403:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.874421:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360421.874433:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360421.876527:0:22771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360421.876560:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787360421.877126:0:22771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787360421.877336:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+36:18819:x1874182575132288:12345-192.168.206.11@tcp:58:bash.0 Request processed in 3029us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360421.877349:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1787360421.885405:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360421.885523:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132416 00000100:00100000:2.0:1787360421.885534:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132416 00000100:00100000:2.0:1787360421.885603:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:2.0:1787360421.885614:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+36:18819:x1874182575132416:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360421.885637:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360421.885661:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef71d expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885725:0:22769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885736:0:22769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 37 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885755:0:22769:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885767:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 37 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885780:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360421.885783:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360421.885786:0:22769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 37 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360421.885812:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696600, rc 0) 00000100:00100000:2.0:1787360421.885977:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+37:18819:x1874182575132416:12345-192.168.206.11@tcp:101:bash.0 Request processed in 269us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360421.885985:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00010000:00010000:2.0:1787360422.139513:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360422.525100:0:22805:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787360422.525111:0:22805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360422.525139:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787360422.525150:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787360422.525332:0:22805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22805:1874182596209664:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360422.525437:0:22805:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360422.534337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.535498:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132544 00000100:00100000:2.0:1787360422.535514:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132544 00000100:00100000:2.0:1787360422.535596:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1787360422.535607:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575132544:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360422.535644:0:24584:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360422.537514:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575132544:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 1897us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.537531:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1787360422.541257:0:22805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fde680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22805:1874182596209664:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787360422.547705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.550822:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132672 00000100:00100000:2.0:1787360422.550837:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132672 00000100:00100000:2.0:1787360422.550980:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787360422.550993:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+37:18820:x1874182575132672:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787360422.551074:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551091:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551102:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551136:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551143:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551150:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551171:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551179:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551184:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360422.551260:0:22769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787360422.551265:0:22769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360422.551280:0:22769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551290:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551297:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551304:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551318:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360422.551322:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551330:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551342:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a037dd700) 00010000:00010000:2.0:1787360422.551345:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360422.551350:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551370:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722150 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551390:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551396:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551401:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551406:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360422.551409:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551414:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551433:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff998a28ecfa00) 00010000:00010000:2.0:1787360422.551436:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360422.551439:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551445:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722157 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551459:0:22769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551465:0:22769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551470:0:22769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551474:0:22769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360422.551477:0:22769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551482:0:22769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551489:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360422.551502:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360422.551505:0:22769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.551511:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72215e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360422.551611:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+37:18820:x1874182575132672:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 620us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.551619:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1787360422.557632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.557999:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575132928 00000100:00100000:0.0:1787360422.558010:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575132928 00000100:00100000:0.0:1787360422.558080:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787360422.558091:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+37:18820:x1874182575132928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.558114:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360422.558136:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee722165 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef724 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.558306:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.558321:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.558332:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360422.558343:0:22771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360422.559083:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559093:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559116:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559121:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33fa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.559126:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559134:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559148:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.559152:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360422.559157:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559163:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee72216c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559278:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee722165 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef724 expref: 39 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559291:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a037dd700) 00010000:00010000:0.0:1787360422.559293:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360422.559298:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee722165 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef724 expref: 39 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.559308:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f600, rc 0) 00000100:00100000:0.0:1787360422.559870:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575132928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1769us (2235us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787360422.559891:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1787360422.565177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.565324:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575133056 00000100:00100000:1.0:1787360422.565334:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575133056 00000100:00100000:1.0:1787360422.565402:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1787360422.565413:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575133056:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787360422.565449:0:22770:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787360422.565577:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575133056:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 166us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.565586:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1787360422.580299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.582320:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575133312 00000100:00100000:0.0:1787360422.582336:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575133312 00000100:00100000:2.0:1787360422.582669:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1787360422.582684:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+38:18820:x1874182575133312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360422.582718:0:24584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360422.582742:0:24584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72217a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef72b expref: -99 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360422.583351:0:24584:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:2.0:1787360422.583475:0:24584:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1787360422.583501:0:24584:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787360422.584328:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722181 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.584345:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722181 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.584428:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722181 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.584496:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72217a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef72b expref: 41 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.584517:0:24584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722181 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef72b expref: 40 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.585518:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:2.0:1787360422.585522:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360422.585525:0:24584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697e00, rc 0) 00000100:00100000:2.0:1787360422.585615:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+40:18820:x1874182575133312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2932us (5322us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1787360422.585624:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1787360422.590824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.591091:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575133568 00000100:00100000:1.0:1787360422.591101:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575133568 00000100:00100000:1.0:1787360422.591160:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:1.0:1787360422.591170:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+40:18820:x1874182575133568:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787360422.591264:0:22770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360422.591291:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee722181 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef72b expref: 40 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591328:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:1.0:1787360422.591339:0:22770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360422.591467:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591480:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591490:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591505:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591511:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591517:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591664:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591671:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591677:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591682:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360422.591686:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591700:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591709:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:1.0:1787360422.591712:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360422.591715:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591721:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee72218f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591730:0:22770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591736:0:22770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591741:0:22770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591745:0:22770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeea00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360422.591748:0:22770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591753:0:22770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591759:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x37ac0af1 (ffff998a28ed3300) 00010000:00010000:1.0:1787360422.591761:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360422.591764:0:22770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.591778:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee722196 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x37ac0af1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360422.591863:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+39:18820:x1874182575133568:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 693us (1046us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360422.591871:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1787360422.595674:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.595894:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575133696 00000100:00100000:0.0:1787360422.595904:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575133696 00000100:00100000:0.0:1787360422.595964:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:0.0:1787360422.595975:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+39:18820:x1874182575133696:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.595996:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360422.596017:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee72219d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef732 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596051:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee7221a4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596063:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee7221a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596074:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee7221a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596183:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee72219d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef732 expref: 41 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596205:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fa00/0x359a4e2aee7221a4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef732 expref: 40 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.596272:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:0.0:1787360422.596288:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360422.596292:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33fa00, rc 0) 00000100:00100000:0.0:1787360422.596347:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+40:18820:x1874182575133696:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 373us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.596356:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:3.0:1787360422.602032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.602499:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575133952 00000100:00100000:1.0:1787360422.602509:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575133952 00000100:00100000:1.0:1787360422.602577:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1787360422.602588:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+40:18820:x1874182575133952:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787360422.602671:0:22770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.602689:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.602700:0:22770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360422.602872:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1787360422.602883:0:22770:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 700849656406ns, next at 701849653594ns, rc = 0 00000004:00010000:1.0:1787360422.602935:0:22770:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2094950 reply state 000000006b9f3060 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.602948:0:22770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.602956:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:1.0:1787360422.602968:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787360422.602972:0:22770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360422.603074:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+42:18820:x1874182575133952:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 487us (1051us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1787360422.603082:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1787360422.608054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.611176:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134080 00000100:00100000:0.0:1787360422.611191:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134080 00000100:00100000:0.0:1787360422.611319:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1787360422.611331:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+42:18820:x1874182575134080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.611356:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360422.611377:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef739 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.611437:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 43 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.611452:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 43 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.611471:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:0.0:1787360422.611474:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360422.611479:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33f600, rc 0) 00000100:00100000:0.0:1787360422.611547:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+43:18820:x1874182575134080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 218us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.611554:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:3.0:1787360422.618999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.619097:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134208 00000100:00100000:2.0:1787360422.619108:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134208 00000100:00100000:2.0:1787360422.619190:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1787360422.619202:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c61ba93f-dce6-49e7-928d-2c5364490956+5:2400:x1874182575134208:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787360422.619492:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360422.619699:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c61ba93f-dce6-49e7-928d-2c5364490956+6:2400:x1874182575134208:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 497us (718us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787360422.619708:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787360422.622183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.622449:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134464 00000100:00100000:2.0:1787360422.622461:0:22772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134464 00000100:00100000:2.0:1787360422.622524:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360422.622534:0:22772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+43:18820:x1874182575134464:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787360422.623499:0:22772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c61ba93f-dce6-49e7-928d-2c5364490956+44:18820:x1874182575134464:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 959us (1317us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787360422.623510:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:0.0:1787360422.634438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.634558:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134720 00000100:00100000:1.0:1787360422.634570:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134720 00000100:00100000:1.0:1787360422.634634:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:1.0:1787360422.634647:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+44:18820:x1874182575134720:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787360422.634772:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+44:18820:x1874182575134720:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 126us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.634782:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360422.638303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.638500:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134848 00000100:00100000:0.0:1787360422.638510:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134848 00000100:00100000:0.0:1787360422.638616:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:0.0:1787360422.638627:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+44:18820:x1874182575134848:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.638649:0:22771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360422.638670:0:22771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33e800/0x359a4e2aee7221b9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef740 expref: -99 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638773:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638789:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638801:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360422.638846:0:22771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360422.638865:0:22771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638892:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33e800/0x359a4e2aee7221b9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef740 expref: 46 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638987:0:22771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef740 expref: 45 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.638998:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:0.0:1787360422.639001:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360422.639005:0:22771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3e33fe00, rc 0) 00000100:00100000:0.0:1787360422.639080:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+45:18820:x1874182575134848:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 455us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.639088:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:3.0:1787360422.642772:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.643557:0:25221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575134976 00000100:00100000:1.0:1787360422.643568:0:25221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575134976 00000100:00100000:1.0:1787360422.643639:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360422.643650:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c61ba93f-dce6-49e7-928d-2c5364490956+6:2400:x1874182575134976:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360422.643669:0:25221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360422.643691:0:25221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef747 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360422.643717:0:25221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f4a6, blocks: 0x0 00010000:00010000:1.0:1787360422.643737:0:25221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=700s v=(0 0) 00010000:00010000:1.0:1787360422.643742:0:25221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360422.643752:0:25221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 7 pid: 25221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.643772:0:25221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 7 pid: 25221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.643802:0:25221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:1.0:1787360422.643880:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c61ba93f-dce6-49e7-928d-2c5364490956+7:2400:x1874182575134976:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 231us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.643887:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1787360422.648956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.649028:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575135232 00000100:00100000:1.0:1787360422.649037:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575135232 00000100:00100000:1.0:1787360422.649100:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360422.649110:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+45:18820:x1874182575135232:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787360422.649677:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+45:18820:x1874182575135232:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 565us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.649687:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360422.654560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.654678:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575135360 00000100:00100000:3.0:1787360422.654689:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575135360 00000100:00100000:3.0:1787360422.654757:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:3.0:1787360422.654771:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+45:18820:x1874182575135360:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787360422.657547:0:22749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1787360422.657565:0:22749:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787360422.657640:0:22749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1787360422.657699:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657722:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657730:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657736:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360422.657740:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657764:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657783:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:1.0:1787360422.657786:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787360422.657791:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.657796:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517800/0x359a4e2aee721fa5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657890:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657898:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657905:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657910:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.657914:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657921:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657931:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9989025f4500) 00010000:00010000:0.0:1787360422.657934:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.657937:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657944:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee721f43 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657962:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657968:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657981:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657986:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.657989:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.657998:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658005:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:0.0:1787360422.658007:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.658010:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658015:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee721f4a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658027:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658033:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658039:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658044:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.658046:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658062:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658071:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998a28ed3600) 00010000:00010000:0.0:1787360422.658073:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.658076:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658081:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee722000 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658094:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658100:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658105:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658109:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.658111:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658116:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658122:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.658125:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.658127:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658138:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee7220bd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658151:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658157:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658162:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658167:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.658170:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658175:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658183:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.658185:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.658188:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658193:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7220e0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658203:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658209:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658266:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658270:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.658273:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658280:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658289:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.658291:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.658294:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658300:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee722126 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658312:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658319:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658324:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658329:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeea00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.658332:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658348:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658357:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:0.0:1787360422.658359:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787360422.658362:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.658367:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee7221ab lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360422.658962:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+14:18820:x1874182575135360:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 4189us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.658984:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:1.0:1787360422.659061:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3e346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596209792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787360422.659114:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360422.659346:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596209792 00000100:00100000:3.0:1787360422.659353:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596209792 00000100:00100000:3.0:1787360422.659410:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787360422.659419:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596209792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787360422.659542:0:24275:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787360422.659546:0:24275:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787360422.659548:0:24275:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787360422.659550:0:24275:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787360422 -> 1787360422 00002000:00010000:3.0:1787360422.659553:0:24275:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787360422.659591:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1874182596209792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (477us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787360422.659596:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1787360422.659972:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998a3e346d80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787360422.659979:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3e346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596209792:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787360422.660039:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360422.663272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.663426:0:24276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575135488 00000100:00100000:3.0:1787360422.663435:0:24276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575135488 00000100:00100000:3.0:1787360422.663491:0:24276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360422.663502:0:24276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+7:2400:x1874182575135488:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787360422.663627:0:24276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c61ba93f-dce6-49e7-928d-2c5364490956+7:2400:x1874182575135488:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.663635:0:24276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:0.0:1787360422.666739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.667066:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575135744 00000100:00100000:2.0:1787360422.667076:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575135744 00000100:00100000:2.0:1787360422.667139:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:2.0:1787360422.667166:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+14:18820:x1874182575135744:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360422.667287:0:22769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360422.667317:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221c0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef740 expref: 14 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.667340:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:2.0:1787360422.667346:0:22769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360422.667379:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee7221ce lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.667392:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee7221ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.667402:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee7221ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360422.667530:0:22769:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fade7830 reply state 0000000063c13a12 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee7221ce lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.667543:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee7221ce lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.667549:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:2.0:1787360422.667552:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360422.667555:0:22769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360422.667652:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+15:18820:x1874182575135744:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 489us (922us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787360422.667660:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:2.0:1787360422.671489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.671588:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575135872 00000100:00100000:3.0:1787360422.671599:0:25219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575135872 00000100:00100000:3.0:1787360422.671694:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:3.0:1787360422.671715:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c61ba93f-dce6-49e7-928d-2c5364490956+7:18820:x1874182575135872:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360422.671749:0:25219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360422.671768:0:25219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef74e expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.671802:0:25219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.671812:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360422.671816:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360422.671821:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.671871:0:25219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.671887:0:25219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 800 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360422.671902:0:25219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3e345880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25219:1874182596209920:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360422.671997:0:25219:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360422.674686:0:25219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3e345880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25219:1874182596209920:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360422.674742:0:25219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.674768:0:25219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041000, rc 0) 00000100:00100000:1.0:1787360422.674839:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c61ba93f-dce6-49e7-928d-2c5364490956+8:18820:x1874182575135872:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 3135us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.674850:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1787360422.678325:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.678426:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136000 00000100:00100000:0.0:1787360422.678436:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136000 00010000:00010000:0.0:1787360422.678476:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 800 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.678520:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1787360422.678531:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+8:2400:x1874182575136000:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360422.678546:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360422.678570:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 800 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.678586:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 800 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.678631:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2c3720b/0x359a4e2aee7221c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef747 expref: 8 pid: 25221 timeout: 800 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.678649:0:22756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360422.678654:0:22756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360422.678660:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 7 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.678671:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 7 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.678725:0:22756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 7 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.678741:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22756:1874182596210048:192.168.206.11@tcp:105: 00000100:00100000:0.0:1787360422.678838:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360422.682474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.682601:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22756:1874182596210048:192.168.206.11@tcp:105: 00010000:00010000:0.0:1787360422.682627:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360422.682696:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+7:2400:x1874182575136000:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 4166us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.682716:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787360422.682857:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136128 00000100:00100000:3.0:1787360422.682874:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136128 00000100:00100000:3.0:1787360422.682929:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:3.0:1787360422.682939:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c61ba93f-dce6-49e7-928d-2c5364490956+7:2399:x1874182575136128:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787360422.683102:0:24273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787360422.683112:0:24273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787360421 00002000:00010000:3.0:1787360422.683115:0:24273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787360420 00002000:00010000:3.0:1787360422.683117:0:24273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787360422 -> 1787360421 00002000:00010000:3.0:1787360422.683120:0:24273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787360422.683147:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c61ba93f-dce6-49e7-928d-2c5364490956+8:2399:x1874182575136128:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 210us (685us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787360422.683153:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1787360422.686749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.686837:0:25221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136256 00000100:00100000:0.0:1787360422.686846:0:25221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136256 00000100:00100000:0.0:1787360422.686913:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:0.0:1787360422.686940:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a30b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c61ba93f-dce6-49e7-928d-2c5364490956+8:2402:x1874182575136256:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.686988:0:25221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.687010:0:25221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.687019:0:25221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360422.687024:0:25221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360422.687029:0:25221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.687067:0:25221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.687083:0:25221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 8 pid: 25219 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.687098:0:25221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25221:1874182596210176:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360422.687186:0:25221:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360422.689474:0:25221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25221:1874182596210176:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360422.689505:0:25221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360422.691483:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.691579:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136384 00000100:00100000:2.0:1787360422.691590:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136384 00010000:00010000:2.0:1787360422.691640:0:22754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 9 pid: 25219 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360422.691685:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360422.691695:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+9:2399:x1874182575136384:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360422.691720:0:22754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360422.691743:0:22754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 9 pid: 25219 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.691757:0:22754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 9 pid: 25219 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.691780:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee7221d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef74e expref: 9 pid: 25219 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.691799:0:22754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360422.691803:0:22754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360422.691809:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.691818:0:22754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.691851:0:22754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360422.691931:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c61ba93f-dce6-49e7-928d-2c5364490956+8:2399:x1874182575136384:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 235us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.691939:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00010000:00010000:0.0:1787360422.692005:0:25221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692021:0:25221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692041:0:25221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692050:0:25221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692058:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692065:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33ea00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360422.692070:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692080:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692094:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.692100:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aef1187a/0x359a4e2aee7221dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.692163:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a30b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c61ba93f-dce6-49e7-928d-2c5364490956+7:2402:x1874182575136256:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 5225us (5426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.692172:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:1.0:1787360422.695882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.695971:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136640 00000100:00100000:0.0:1787360422.695984:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136640 00000100:00100000:0.0:1787360422.696046:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1787360422.696057:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+15:18820:x1874182575136640:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787360422.696139:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.696156:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 15 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.696165:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.696198:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 15 pid: 24584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.696211:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 15 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.696279:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210304:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360422.696352:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360422.706307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.706440:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210304:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360422.706482:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360422.706575:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136768 00000100:00100000:2.0:1787360422.706582:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136768 00010000:00010000:2.0:1787360422.706618:0:22756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 16 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360422.706658:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360422.706668:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+16:2399:x1874182575136768:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360422.706682:0:22756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360422.706688:0:22756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 16 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706700:0:22756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 16 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706733:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7220b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef6ec expref: 16 pid: 24584 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706751:0:22756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360422.706756:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 15 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706766:0:22756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706772:0:22756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706786:0:22756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.706818:0:22756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360422.707170:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c61ba93f-dce6-49e7-928d-2c5364490956+15:2399:x1874182575136768:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 501us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.707179:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00010000:00010000:1.0:1787360422.708553:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.708567:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.708801:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.708820:0:22771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 15 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.708841:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.709440:0:22771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 15 pid: 22771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.709458:0:22771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 15 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360422.709473:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210432:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360422.710076:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a31383480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360422.714866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.715140:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575136896 00000100:00100000:3.0:1787360422.715150:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575136896 00010000:00010000:3.0:1787360422.715191:0:22755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 16 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360422.715287:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360422.715299:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a05d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c61ba93f-dce6-49e7-928d-2c5364490956+16:2400:x1874182575136896:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360422.715314:0:22755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360422.715322:0:22755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 16 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.715337:0:22755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 16 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.715360:0:22755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:3.0:1787360422.715366:0:22755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.715375:0:22755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.715405:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.715425:0:22755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360422.715478:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a05d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c61ba93f-dce6-49e7-928d-2c5364490956+16:2400:x1874182575136896:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 181us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.715486:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:0.0:1787360422.716291:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f600/0x359a4e2aee7221b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef739 expref: 15 pid: 22771 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.716312:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210432:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360422.716332:0:22771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.716341:0:22771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.716347:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360422.716451:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1787360422.716571:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1787360422.716611:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1787360422.716696:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22771:1874182596210560:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787360422.716772:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360422.716810:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3c9af900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360422.717645:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596210560 00000100:00100000:3.0:1787360422.717656:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596210560 00000100:00100000:3.0:1787360422.717726:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787360422.717738:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1874182596210560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360422.718016:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22771:x1874182596210560:12345-0@lo:1000:mdt00_002.0 Request processed in 280us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.718024:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787360422.718122:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904fdd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22771:1874182596210560:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787360422.718364:0:22771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1787360422.718431:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22771:1874182596210688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360422.718468:0:22771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360422.718491:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360422.718695:0:23510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596210688 00000100:00100000:3.0:1787360422.718711:0:23510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596210688 00000100:00100000:3.0:1787360422.718750:0:23510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787360422.718759:0:23510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22771:x1874182596210688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360422.719159:0:23510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22771:x1874182596210688:12345-0@lo:1000:mdt00_002.0 Request processed in 400us (690us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787360422.719167:0:23510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360422.719376:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22771:1874182596210688:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787360422.719420:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719429:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719435:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719441:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360422.719445:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719451:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719466:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:1.0:1787360422.719470:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360422.719474:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719479:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee7221ea lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719510:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719516:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719521:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719536:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360422.719539:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719544:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719552:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:1.0:1787360422.719554:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360422.719560:0:22771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 18 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719570:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 18 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719577:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 18 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.719631:0:22771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696600/0x359a4e2aee722149 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef71d expref: 18 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360422.719644:0:22771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210816:192.168.206.11@tcp:105: 00000100:00100000:1.0:1787360422.719722:0:22771:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360422.723064:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.723155:0:22771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22771:1874182596210816:192.168.206.11@tcp:105: 00010000:00010000:0.0:1787360422.723182:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723192:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722142 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723265:0:22771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723295:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723306:0:22771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723317:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723324:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723330:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723335:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33ee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.723339:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723346:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723357:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.723360:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.723364:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723370:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee7221f1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723380:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723392:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723398:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723403:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33fe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.723406:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723411:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723418:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.723420:0:22771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360422.723423:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.723428:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee7221e3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360422.723641:0:22805:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787360422.723646:0:22805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360422.723675:0:22805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787360422.723681:0:22805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787360422.723851:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137024 00000100:00100000:2.0:1787360422.723858:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137024 00000100:00100000:2.0:1787360422.723911:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360422.723921:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+19:18819:x1874182575137024:12345-192.168.206.11@tcp:49:bash.0 00000100:00100000:0.0:1787360422.724322:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c61ba93f-dce6-49e7-928d-2c5364490956+19:18820:x1874182575136640:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 28264us (28456us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1787360422.724333:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000020:00080000:0.0:1787360422.724338:0:22771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787360422.724427:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+18:18819:x1874182575137024:12345-192.168.206.11@tcp:49:bash.0 Request processed in 505us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.724435:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1787360422.727815:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.727993:0:25219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137408 00000100:00100000:1.0:1787360422.728002:0:25219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137408 00000100:00100000:1.0:1787360422.728058:0:25219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1787360422.728068:0:25219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c61ba93f-dce6-49e7-928d-2c5364490956+7:18819:x1874182575137408:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360422.728105:0:25219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360422.728126:0:25219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee7221f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef755 expref: -99 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360422.728150:0:25219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a88f4a5, atime: 0x6a88f4a4, ctime: 0x6a88f4a5, blocks: 0x0 00010000:00010000:1.0:1787360422.728172:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=700s v=(0 0) 00010000:00010000:1.0:1787360422.728177:0:25219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360422.728187:0:25219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee7221f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef755 expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.728203:0:25219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee7221f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef755 expref: 8 pid: 25219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.728252:0:25219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:1.0:1787360422.728306:0:25219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c61ba93f-dce6-49e7-928d-2c5364490956+8:18819:x1874182575137408:12345-192.168.206.11@tcp:101:bash.0 Request processed in 239us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360422.728313:0:25219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1787360422.730754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.730848:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137280 00000100:00100000:2.0:1787360422.730858:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137280 00000100:00100000:2.0:1787360422.730925:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:2.0:1787360422.730936:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+18:18820:x1874182575137280:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787360422.731197:0:22773:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787360422.731276:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1787360422.731310:0:22773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731326:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731337:0:22773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731360:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731366:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731373:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.731396:0:22773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787360422.731486:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+20:18820:x1874182575137280:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 550us (739us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1787360422.731493:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000020:00080000:2.0:1787360422.731498:0:22773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787360422.731625:0:22757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360422.731632:0:22757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.731649:0:22757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360422.731653:0:22757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.731660:0:22757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.731673:0:22757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998a037dd100) 00010000:00010000:3.0:1787360422.731675:0:22757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787360422.731680:0:22757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.731686:0:22757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee7221ff lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360422.731699:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360422.731700:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360422.731702:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360422.734277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.734412:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137536 00000100:00100000:2.0:1787360422.734421:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137536 00000100:00100000:2.0:1787360422.734479:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360422.734489:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+20:18819:x1874182575137536:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360422.734511:0:22769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360422.734531:0:22769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722206 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef75c expref: -99 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734564:0:22769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72220d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734576:0:22769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72220d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734587:0:22769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72220d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734718:0:22769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697800/0x359a4e2aee722206 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef75c expref: 22 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734736:0:22769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee72220d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef75c expref: 21 pid: 22769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360422.734743:0:22769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:2.0:1787360422.734746:0:22769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360422.734750:0:22769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697400, rc 0) 00000100:00100000:2.0:1787360422.734813:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+21:18819:x1874182575137536:12345-192.168.206.11@tcp:101:bash.0 Request processed in 325us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.734820:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:1.0:1787360422.741093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.741175:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137792 00000100:00100000:2.0:1787360422.741186:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137792 00000100:00100000:2.0:1787360422.741288:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:2.0:1787360422.741299:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+21:18819:x1874182575137792:12345-192.168.206.11@tcp:35:bash.0 00000001:00080000:2.0:1787360422.741529:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1787360422.741625:0:22773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1787360422.741748:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+24:18819:x1874182575137792:12345-192.168.206.11@tcp:35:bash.0 Request processed in 450us (663us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1787360422.741756:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000020:00080000:2.0:1787360422.741762:0:22773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787360422.762781:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.762840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.762882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.762919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.762935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360422.762965:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138560 00000100:00100000:3.0:1787360422.762975:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138560 00000100:00100000:3.0:1787360422.763028:0:24275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138176 00000100:00100000:3.0:1787360422.763031:0:24275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138176 00000100:00100000:3.0:1787360422.763059:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:3.0:1787360422.763069:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138560:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360422.763154:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138560:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.763162:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:3.0:1787360422.763181:0:24275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1787360422.763188:0:24275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575138176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360422.763265:0:24275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575138176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.763274:0:24275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1787360422.763287:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138048 00000100:00100000:0.0:1787360422.763293:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138048 00000100:00080000:3.0:1787360422.763297:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360422.763305:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360422.763337:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138304 00000100:00100000:3.0:1787360422.763343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.763343:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138304 00000100:00100000:0.0:1787360422.763386:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138432 00000100:00100000:0.0:1787360422.763390:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138432 00000100:00100000:0.0:1787360422.763415:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1787360422.763420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.763429:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575138048:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360422.763443:0:24273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138688 00000100:00100000:3.0:1787360422.763448:0:24273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138688 00000100:00100000:3.0:1787360422.763477:0:24273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1787360422.763484:0:24273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138688:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360422.763540:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c61ba93f-dce6-49e7-928d-2c5364490956+5:2402:x1874182575138048:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 114us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.763548:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1787360422.763563:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787360422.763582:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2402:x1874182575138304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360422.763660:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575137920 00000100:00100000:2.0:1787360422.763665:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575137920 00000100:00100000:2.0:1787360422.763696:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:2.0:1787360422.763703:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:2402:x1874182575137920:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360422.763762:0:24273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138688:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 277us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.763769:0:24273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1787360422.763908:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1787360422.763916:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360422.763948:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+5:2402:x1874182575138432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360422.763954:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1787360422.766801:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d96d89d-c68a-4f37-a626-1a4c9be7a00b+6:2402:x1874182575138304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 3206us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.767542:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00080000:0.0:1787360422.767584:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360422.767590:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360422.767593:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360422.777267:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1ccd43f-7c56-4917-88d4-56dbba5a33ca+13:2402:x1874182575137920:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 13522us (14305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360422.777283:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:3.0:1787360422.875494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360422.875633:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575138944 00000100:00100000:1.0:1787360422.875645:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575138944 00000100:00100000:1.0:1787360422.875719:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:1.0:1787360422.875729:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+24:18830:x1874182575138944:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360422.875756:0:22770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360422.875777:0:22770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee722214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef763 expref: -99 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360422.876027:0:22770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787360422.876124:0:22770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee722214 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef763 expref: 26 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.876139:0:22770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed3e00) 00010000:00010000:1.0:1787360422.876142:0:22770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360422.876147:0:22770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee722214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef763 expref: 26 pid: 22770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360422.876162:0:22770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee200, rc 0) 00000100:00100000:1.0:1787360422.876279:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c61ba93f-dce6-49e7-928d-2c5364490956+25:18830:x1874182575138944:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 551us (796us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1787360422.876287:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:3.0:1787360422.879603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360422.879727:0:24584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575139072 00000100:00100000:0.0:1787360422.879739:0:24584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575139072 00000100:00100000:0.0:1787360422.879803:0:24584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:0.0:1787360422.879814:0:24584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+25:18830:x1874182575139072:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360422.879919:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.879936:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.879971:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.879988:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.879995:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880002:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880088:0:24584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880097:0:24584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880104:0:24584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360422.880149:0:24584:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880162:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880169:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880176:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880192:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33fe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.880197:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880204:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880276:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:0.0:1787360422.880280:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.880285:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880291:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33fe00/0x359a4e2aee722222 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880307:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880313:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880318:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880322:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33ee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.880325:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880330:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880348:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998a037dd900) 00010000:00010000:0.0:1787360422.880350:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.880354:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880359:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33ee00/0x359a4e2aee722229 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880374:0:24584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880379:0:24584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880385:0:24584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880390:0:24584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3e33f200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360422.880392:0:24584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880397:0:24584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880403:0:24584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff998a28ed3900) 00010000:00010000:0.0:1787360422.880405:0:24584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360422.880407:0:24584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360422.880412:0:24584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3e33f200/0x359a4e2aee722230 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24584 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360422.880505:0:24584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c61ba93f-dce6-49e7-928d-2c5364490956+25:18830:x1874182575139072:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 691us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360422.880513:0:24584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:3.0:1787360422.885716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360422.885798:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575139328 00000100:00100000:2.0:1787360422.885807:0:22773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575139328 00000100:00100000:2.0:1787360422.885880:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:2.0:1787360422.885891:0:22773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3e344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+25:18830:x1874182575139328:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360422.886109:0:22773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3e344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c61ba93f-dce6-49e7-928d-2c5364490956+26:18830:x1874182575139328:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 218us (411us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1787360422.886117:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00010000:00010000:2.0:1787360423.162763:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360423.673575:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3e347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596210944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360423.673652:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360423.673805:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596211072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360423.673834:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360423.674006:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596210944 00000100:00100000:3.0:1787360423.674015:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596210944 00000100:00100000:3.0:1787360423.674059:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211072 00000100:00100000:3.0:1787360423.674061:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211072 00000100:00100000:3.0:1787360423.674075:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360423.674082:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596210944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360423.674115:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360423.674165:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596210944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360423.674171:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360423.674186:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787360423.674190:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596211072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360423.674204:0:22774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787360423.674263:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596211072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360423.674269:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787360423.674306:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596211072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360423.674380:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3e347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596210944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360423.674527:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596211200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360423.674556:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360423.674656:0:24277:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211200 00000100:00100000:2.0:1787360423.674660:0:24277:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211200 00000100:00100000:2.0:1787360423.674702:0:24277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360423.674708:0:24277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596211200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360423.674725:0:24277:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787360423.674761:0:24277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596211200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360423.674766:0:24277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787360423.674812:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360423.674862:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596211200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360424.186633:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596211328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360424.186735:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360424.186840:0:22757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360424.187644:0:25808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211328 00000100:00100000:0.0:1787360424.187654:0:25808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211328 00000100:00100000:0.0:1787360424.187729:0:25808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360424.187744:0:25808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596211328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360424.187782:0:25808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360424.187885:0:25808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596211328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.187892:0:25808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360424.187953:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596211456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360424.187989:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360424.188034:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360424.188047:0:24278:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211456 00000100:00100000:0.0:1787360424.188051:0:24278:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211456 00000100:00100000:0.0:1787360424.188091:0:24278:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360424.188099:0:24278:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596211456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360424.188113:0:24278:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787360424.188153:0:24278:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596211456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.188159:0:24278:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787360424.188193:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360424.188340:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596211712:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.188372:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.188790:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596212224:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.188823:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.188844:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596212736:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.188935:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.188963:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787360424.188969:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596211840:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.188993:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.189012:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596212352:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.189034:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.189051:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596212864:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.189070:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.189098:0:22774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211712 00000100:00100000:0.0:1787360424.189105:0:22774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211712 00000100:00100000:0.0:1787360424.189142:0:22774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360424.189151:0:22774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596211712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.189203:0:22774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596211712:12345-0@lo:400:kworker.0 Request processed in 53us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.189221:0:22774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360424.189269:0:25221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212224 00000100:00100000:0.0:1787360424.189274:0:25221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212224 00000100:00100000:0.0:1787360424.189303:0:25221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211840 00000100:00100000:0.0:1787360424.189306:0:25221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211840 00000100:00100000:0.0:1787360424.189338:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360424.189346:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596212224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360424.190200:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596211328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360424.193684:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596212224:12345-0@lo:400:kworker.0 Request processed in 4325us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.193702:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360424.193748:0:25221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360424.193767:0:25221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596211840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.193949:0:25221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596211840:12345-0@lo:400:kworker.0 Request processed in 192us (4954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.193957:0:25221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360424.193991:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212736 00000100:00100000:0.0:1787360424.194001:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212736 00000100:00100000:0.0:1787360424.195190:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212352 00000100:00100000:0.0:1787360424.195201:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212352 00000100:00100000:3.0:1787360424.197190:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212864 00000100:00100000:3.0:1787360424.197217:0:22771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212864 00000100:00100000:3.0:1787360424.197294:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360424.197309:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596212736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360424.197472:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596212736:12345-0@lo:400:kworker.0 Request processed in 167us (8537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360424.197488:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360424.197511:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787360424.197519:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596212352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360424.197555:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596212352:12345-0@lo:400:kworker.0 Request processed in 37us (8520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360424.197561:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787360424.197585:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787360424.197593:0:22771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596212864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360424.197623:0:22771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596212864:12345-0@lo:400:kworker.0 Request processed in 32us (8552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360424.197629:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787360424.199821:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596211584:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.199926:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360424.199976:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596211968:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.199979:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596212096:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.200036:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360424.200064:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596212480:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200089:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360424.200110:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3e345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596212992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360424.200139:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.200198:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596212608:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200222:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596211456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360424.200263:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360424.200306:0:22775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212096 00000100:00100000:2.0:1787360424.200307:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596211840:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200324:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596212352:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.200329:0:22775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212096 00010000:00080000:2.0:1787360424.200343:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904917480 x1874182596212864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360424.200356:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596212864:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200369:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596211712:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200386:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596212224:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200401:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596212736:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.200407:0:22775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787360424.200431:0:22775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596212096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787360424.200447:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360424.200455:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360424.200459:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360424.200473:0:25808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212992 00000100:00100000:2.0:1787360424.200478:0:25808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212992 00000100:00100000:0.0:1787360424.200494:0:22775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596212096:12345-0@lo:400:kworker.0 Request processed in 65us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.200502:0:22775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787360424.200515:0:25808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360424.200524:0:25808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596212992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360424.200533:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211968 00002000:00000024:2.0:1787360424.200542:0:25808:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360424.200545:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211968 00000100:00100000:2.0:1787360424.200587:0:25808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596212992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.200591:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212480 00000100:00100000:0.0:1787360424.200596:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212480 00000100:00100000:2.0:1787360424.200597:0:25808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360424.200623:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596212608 00000100:00100000:2.0:1787360424.200628:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596212608 00000100:00100000:0.0:1787360424.200635:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787360424.200645:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596211968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200656:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360424.200666:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.200687:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596211968:12345-0@lo:400:kworker.0 Request processed in 43us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.200695:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787360424.200714:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360424.200720:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596212480:12345-0@lo:400:kworker.0 Request processed in 55us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.200725:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596212608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200734:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360424.200768:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596211968:0@lo:400:kworker.0 00000100:00100000:0.0:1787360424.200771:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596212608:12345-0@lo:400:kworker.0 Request processed in 50us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360424.200781:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360424.200785:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596212480:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.200803:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3e345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596212992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787360424.200805:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360424.200812:0:22765:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360424.200844:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596212096:0@lo:400:kworker.0 00010000:00080000:0.0:1787360424.200856:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059c00 x1874182596212608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360424.200865:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596212608:0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.204603:0:25811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596211584 00000100:00100000:2.0:1787360424.204620:0:25811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596211584 00000100:00100000:2.0:1787360424.205673:0:25811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787360424.205692:0:25811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3659:x1874182596211584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360424.205818:0:25811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3d37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:68392ef7-c60d-4fc0-a5e6-6a46b1db50be+24:3659:x1874182596211584:12345-0@lo:400:kworker.0 Request processed in 133us (5892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360424.205827:0:25811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787360424.205958:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68392ef7-c60d-4fc0-a5e6-6a46b1db50be:3659:1874182596211584:0@lo:400:kworker.0 00000001:02000400:3.0:1787360424.249687:0:25853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:3.0:1787360424.763385:0:23523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787360425.209447:0:22758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14380 lines, 14380 kept, 0 dropped, 0 bad.