00000040:00080000:2.0F:1788625424.459862:0:17273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788625424.459883:0:17273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625424.459915:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788625424.459927:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0F:1788625424.779690:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788625425.676360:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206269952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625425.676465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788625425.678502:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206270080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625425.678629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625425.679224:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206269952 00000100:00100000:3.0:1788625425.679240:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206269952 00000100:00100000:0.0:1788625425.680034:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270080 00000100:00100000:0.0:1788625425.680040:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270080 00000100:00100000:0.0:1788625425.680192:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625425.680204:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206270080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625425.680241:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625425.680324:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206270080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625425.680331:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625425.680390:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206270080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625425.680419:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625425.680427:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206269952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788625425.680453:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788625425.680496:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206269952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625425.680501:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625425.681553:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206269952:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788625425.681886:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788625425.690671:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788625425.690716:0:17219:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9988781a03c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788625425.690723:0:17219:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99887d97cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9988781a0840 00000020:00080000:1.0:1788625425.690727:0:17219:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99887d97ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9987434aa600 00000020:00080000:1.0:1788625425.690760:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1788625425.690865:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788625425.694058:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694080:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694089:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694095:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625425.694101:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694110:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694137:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:3.0:1788625425.694141:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625425.694147:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.694165:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7bc57 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625425.808635:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625426.191303:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625426.191330:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206270208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625426.191421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625426.191497:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270208 00000100:00100000:0.0:1788625426.191505:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270208 00000100:00100000:0.0:1788625426.191574:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625426.191583:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206270208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625426.191620:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625426.191667:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206270208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625426.191674:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625426.191723:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206270208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625426.416991:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625426.417101:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229696 00000100:00100000:0.0:1788625426.417111:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229696 00000100:00100000:0.0:1788625426.417304:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:0.0:1788625426.417317:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:15607:x1875509185229696:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788625426.417444:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:15607:x1875509185229696:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 130us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625426.417452:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00080000:3.0:1788625426.417706:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625426.423415:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625426.423719:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185229824 00000100:00100000:2.0:1788625426.423732:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185229824 00000100:00100000:2.0:1788625426.423808:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00100000:2.0:1788625426.423819:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15607:x1875509185229824:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788625426.423936:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:15607:x1875509185229824:12345-192.168.204.14@tcp:60:lhsmtool_posix.0 Request processed in 120us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625426.423944:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00080000:3.0:1788625426.424714:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625426.431328:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625426.431385:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625426.431452:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230208 00000100:00100000:1.0:1788625426.431463:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230208 00000100:00100000:1.0:1788625426.431555:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:1.0:1788625426.431568:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887c9e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:15607:x1875509185230208:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788625426.431833:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887c9e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+13:15607:x1875509185230208:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 268us (512us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788625426.431841:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625426.432380:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230080 00000100:00100000:2.0:1788625426.432387:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230080 00000100:00100000:2.0:1788625426.432434:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 169 00000100:00100000:2.0:1788625426.432443:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185230080:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625426.432490:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185230080:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 49us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625426.432497:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 169 00000100:00100000:3.0:1788625426.441444:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625426.441562:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625426.441596:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230336 00000100:00100000:3.0:1788625426.441618:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230336 00000100:00100000:3.0:1788625426.441679:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230464 00000100:00100000:3.0:1788625426.441683:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230464 00000100:00100000:3.0:1788625426.441725:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:3.0:1788625426.441737:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185230464:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625426.441769:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:2.0:1788625426.441781:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2390:x1875509185230336:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:2.0:1788625426.441804:0:19761:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b90f 00000100:00100000:3.0:1788625426.441822:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185230464:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00080000:2.0:1788625426.441822:0:19761:0:(import.c:65:import_set_state_nolock()) ffff998845926800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788625426.441834:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00080000:3.0:1788625426.441867:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625426.441872:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788625426.441872:0:19761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788625426.442326:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+2:2390:x1875509185230336:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 547us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625426.442335:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00010000:00010000:2.0:1788625426.442358:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625426.456563:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625426.456642:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230720 00000100:00100000:2.0:1788625426.456653:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230720 00000100:00100000:2.0:1788625426.457334:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:2.0:1788625426.457349:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2391:x1875509185230720:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625426.457404:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625426.457552:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625426.457603:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625426.457638:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230848 00000100:00100000:0.0:1788625426.457643:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230848 00000100:00100000:0.0:1788625426.457679:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230976 00000100:00100000:0.0:1788625426.457683:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230976 00000100:00100000:0.0:1788625426.457704:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625426.457712:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2390:x1875509185230848:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:0.0:1788625426.457741:0:19755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b94e 00000100:00080000:0.0:1788625426.457768:0:19755:0:(import.c:65:import_set_state_nolock()) ffff998845921800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625426.457815:0:19755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788625426.457953:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+2:2390:x1875509185230848:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 241us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625426.457962:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625426.457978:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:0.0:1788625426.457985:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2390:x1875509185230976:12345-192.168.204.14@tcp:9:kworker.0 00000020:00000080:0.0:1788625426.457996:0:19755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b955 00000100:00080000:0.0:1788625426.458002:0:19755:0:(import.c:65:import_set_state_nolock()) ffff998872640000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625426.458026:0:19755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788625426.458140:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+2:2390:x1875509185230976:12345-192.168.204.14@tcp:9:kworker.0 Request processed in 155us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625426.458318:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2391:x1875509185230720:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 97us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625426.458330:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 74 00000100:00100000:2.0:1788625426.458347:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185230592 00000100:00100000:2.0:1788625426.458351:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185230592 00000100:00100000:0.0:1788625426.458409:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00010000:00010000:0.0:1788625426.458446:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625426.458743:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625426.459004:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00100000:1.0:1788625426.459016:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2391:x1875509185230592:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625426.459317:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874427ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2391:x1875509185230592:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 303us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625426.459325:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 75 00000100:00080000:3.0:1788625426.460611:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788625426.460619:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625426.460622:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625426.460626:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788625426.827861:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625427.853565:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625427.981421:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788625428.235804:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625428.235832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206270336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625428.235968:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625428.236104:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270336 00000100:00100000:1.0:1788625428.236126:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270336 00000100:00080000:2.0:1788625428.236626:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625428.236709:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625428.236726:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206270336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625428.236775:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625428.236908:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206270336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625428.236921:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625428.236981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206270336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625428.238314:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206270720:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.238350:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206270464:0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.238452:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206270592:0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.238629:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206270848:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.241375:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.241462:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206270976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.241508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.241551:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206271488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.241575:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.241600:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206272000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625428.241634:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.241698:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270464 00000100:00100000:0.0:1788625428.241709:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270464 00000100:00100000:0.0:1788625428.241783:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788625428.241794:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3635:x1875509206270464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.241861:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3635:x1875509206270464:12345-0@lo:400:kworker.0 Request processed in 69us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.241870:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788625428.243552:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270976 00000100:00100000:0.0:1788625428.243572:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270976 00000100:00100000:0.0:1788625428.245798:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271488 00000100:00100000:0.0:1788625428.245813:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271488 00000100:00100000:0.0:1788625428.245976:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788625428.245992:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206270976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.246118:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206270976:12345-0@lo:400:kworker.0 Request processed in 133us (4608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.246125:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788625428.246146:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788625428.246152:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206271488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.246181:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206271488:12345-0@lo:400:kworker.0 Request processed in 29us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.246186:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788625428.246216:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272000 00000100:00100000:0.0:1788625428.246220:0:20432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272000 00000100:00100000:0.0:1788625428.247096:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625428.247109:0:20432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206272000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788625428.247132:0:20432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788625428.255328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625428.261490:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.261514:0:20432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206272000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14403us (19872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.261545:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788625428.261721:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206270464:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.261743:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206270976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.261759:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206271488:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.261769:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788625428.261774:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99886cbfca80, transno 8589934596 00000004:00080000:0.0:1788625428.261787:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788625428.261821:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206272000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788625428.261827:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206271104:0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.261952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625428.261990:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270592 00000100:00100000:1.0:1788625428.261998:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270592 00000100:00100000:1.0:1788625428.262042:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271104 00000100:00100000:1.0:1788625428.262046:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271104 00000100:00100000:1.0:1788625428.262063:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625428.262073:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206270592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.262130:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206270592:12345-0@lo:400:kworker.0 Request processed in 58us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.262137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206271616:0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.262139:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625428.262155:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788625428.262166:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206271104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.262398:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206271104:12345-0@lo:400:kworker.0 Request processed in 234us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625428.262405:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788625428.262448:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625428.262455:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625428.263001:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270848 00000100:00100000:1.0:1788625428.263008:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270848 00000100:00100000:1.0:1788625428.263045:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788625428.263053:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206270848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.263157:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206270848:12345-0@lo:400:kworker.0 Request processed in 105us (7836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625428.263164:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625428.267333:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625428.267494:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206270720 00000100:00100000:1.0:1788625428.267507:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206270720 00000100:00100000:1.0:1788625428.267602:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625428.267615:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206270720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.268207:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.268254:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271616 00000100:00100000:0.0:1788625428.268260:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271616 00000100:00100000:0.0:1788625428.268304:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788625428.268313:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206271616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.268377:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206271616:12345-0@lo:400:kworker.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.268385:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788625428.268458:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c28700 x1875509206271616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625428.268476:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206271616:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.268490:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206272128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625428.268551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.268578:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272128 00000100:00100000:0.0:1788625428.268582:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272128 00000100:00100000:0.0:1788625428.268745:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625428.268754:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206272128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625428.268834:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625428.268885:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206272128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.268892:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625428.269019:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206272128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625428.269063:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206270592:0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.269076:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206271104:0@lo:400:kworker.0 00000100:00080000:0.0:1788625428.269145:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625428.269152:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625428.269333:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206270848:0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.269345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206271360:0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.269396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625428.269421:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206271872:0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.269449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625428.269494:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271360 00000100:00100000:3.0:1788625428.269499:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271360 00000100:00100000:3.0:1788625428.269546:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271872 00000100:00100000:3.0:1788625428.269550:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271872 00000100:00100000:3.0:1788625428.269575:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625428.269582:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206271360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.269625:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206271360:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625428.269632:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788625428.269645:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788625428.269651:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206271872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.269679:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206271872:12345-0@lo:400:kworker.0 Request processed in 29us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625428.269685:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788625428.269700:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625428.269718:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206271360:0@lo:400:kworker.0 00010000:00080000:3.0:1788625428.269729:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c28a80 x1875509206271872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625428.269738:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206271872:0@lo:400:kworker.0 00000100:00100000:1.0:1788625428.272856:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206270720:12345-0@lo:400:kworker.0 Request processed in 5232us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625428.272881:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625428.273002:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206270720:0@lo:400:kworker.0 00000100:00100000:2.0:1788625428.273017:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206271232:0@lo:400:kworker.0 00000100:00100000:2.0:1788625428.273062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625428.273108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206271744:0@lo:400:kworker.0 00000100:00100000:2.0:1788625428.273137:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625428.273214:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271232 00000100:00100000:0.0:1788625428.273223:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271232 00000100:00100000:0.0:1788625428.273298:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625428.273307:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206271232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625428.273387:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206271232:12345-0@lo:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625428.273393:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625428.273473:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206271232:0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.273542:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206271744 00000100:00100000:3.0:1788625428.273561:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206271744 00000100:00100000:3.0:1788625428.273609:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625428.273617:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206271744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625428.273670:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206271744:12345-0@lo:400:kworker.0 Request processed in 54us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625428.273677:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788625428.273760:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206271744:0@lo:400:kworker.0 00000100:00080000:1.0:1788625428.273775:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625428.273781:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788625428.875854:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625429.900681:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625430.398496:0:20615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:23:47 (1788625427) 00000100:00100000:2.0:1788625430.795804:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206272256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625430.795902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625430.796056:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272256 00000100:00100000:0.0:1788625430.796066:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272256 00000100:00100000:0.0:1788625430.796126:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625430.796135:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206272256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625430.796164:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625430.796214:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206272256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625430.796221:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625430.796263:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744184700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206272256:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788625430.796314:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625430.797081:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625430.797093:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206272384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625430.797185:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625430.797264:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272384 00000100:00100000:2.0:1788625430.797269:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272384 00000100:00100000:2.0:1788625430.797312:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625430.797319:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206272384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625430.797358:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788625430.797407:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206272384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625430.797413:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788625430.797630:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206272384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788625430.924905:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625431.309914:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206272512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625431.310068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625431.311839:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272512 00000100:00100000:2.0:1788625431.311856:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272512 00000100:00100000:2.0:1788625431.311923:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788625431.311935:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206272512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625431.311979:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625431.314018:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206272512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2073us (3937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625431.314033:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788625431.317738:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206272512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625431.557377:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557434:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557475:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557509:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557563:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625431.557608:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231360 00000100:00100000:1.0:1788625431.557620:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231360 00000100:00100000:1.0:1788625431.557679:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231616 00000100:00100000:1.0:1788625431.557683:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231616 00000100:00100000:1.0:1788625431.557696:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231232 00000100:00100000:1.0:1788625431.557699:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231232 00000100:00100000:1.0:1788625431.557711:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231744 00000100:00100000:1.0:1788625431.557713:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231744 00000100:00100000:1.0:1788625431.557727:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:1.0:1788625431.557736:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185231360:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625431.557848:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2392:x1875509185231360:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625431.557856:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 82 00000100:00100000:0.0:1788625431.558244:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231104 00000100:00100000:0.0:1788625431.558250:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231104 00000100:00100000:0.0:1788625431.558296:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 171 00000100:00100000:0.0:1788625431.558305:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185231104:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625431.558335:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2392:x1875509185231104:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 32us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625431.558342:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 171 00000100:00100000:1.0:1788625431.558393:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00100000:1.0:1788625431.558403:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185231616:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625431.558456:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2392:x1875509185231616:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 55us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625431.561487:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:0.0:1788625431.561541:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+13:2392:x1875509185231232:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625431.561630:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2577c14b-df6c-4b8f-a20a-0ae385000d2e+13:2392:x1875509185231232:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 120us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625431.561638:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 84 00000100:00100000:0.0:1788625431.561666:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 85 00000100:00100000:0.0:1788625431.561674:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185231744:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625431.561698:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2392:x1875509185231744:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (4135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625431.561703:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 85 00000100:00100000:0.0:1788625431.561749:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231488 00000100:00100000:0.0:1788625431.561758:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231488 00000100:00100000:0.0:1788625431.561867:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:0.0:1788625431.561885:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185231488:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625431.561913:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2392:x1875509185231488:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 39us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625431.561939:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:1.0:1788625431.562173:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 83 00000100:00080000:1.0:1788625431.562201:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788625431.562206:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625431.562210:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788625431.822513:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000020:00000080:2.0:1788625431.822539:0:18741:0:(genops.c:885:class_export_put()) final put ffff998845922800/3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:2.0:1788625431.822562:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000020:00000080:2.0:1788625431.822565:0:18741:0:(genops.c:885:class_export_put()) final put ffff998845920000/2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000020:00000080:1.0:1788625431.822671:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998845922800/3eda7774-83ed-48ae-a4ab-ef06595559f2 for lustre-OST0000 00000020:00000080:1.0:1788625431.822721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998845920000/2577c14b-df6c-4b8f-a20a-0ae385000d2e for lustre-OST0000 00000020:00000080:1.0:1788625431.822734:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998845921800 for lustre-OST0000 00000020:00000080:1.0:1788625431.822739:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998845926800 for lustre-OST0000 00000001:00080000:0.0:1788625431.822835:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1788625431.822843:0:17219:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788625431.822878:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788625431.822888:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:3.0:1788625431.825601:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000020:00000080:3.0:1788625431.825616:0:19558:0:(genops.c:885:class_export_put()) final put ffff998872646800/3eda7774-83ed-48ae-a4ab-ef06595559f2 00000020:00000080:2.0:1788625431.825718:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998872646800/3eda7774-83ed-48ae-a4ab-ef06595559f2 for lustre-OST0001 00000020:00000080:2.0:1788625431.825785:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998872640000 for lustre-OST0001 00010000:00010000:2.0:1788625431.947938:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625432.971811:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625433.355798:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206272768:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.355885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.355953:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206273280:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.355993:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356011:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206273792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206274304:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356066:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206272640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625433.356081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356100:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788625433.356105:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206272896:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356118:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356127:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356140:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206273408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356153:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206273664:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356157:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356169:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206273920:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356184:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356212:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625433.356217:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206273024:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356259:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356264:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625433.356270:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206274432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625433.356279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356287:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625433.356294:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206274048:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356312:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273152 00000100:00100000:0.0:1788625433.356314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.356319:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273152 00000100:00100000:0.0:1788625433.356332:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273280 00000100:00100000:0.0:1788625433.356335:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273280 00000100:00100000:2.0:1788625433.356368:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273664 00000100:00100000:0.0:1788625433.356368:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273792 00000100:00100000:2.0:1788625433.356371:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273664 00000100:00100000:0.0:1788625433.356371:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273792 00000100:00100000:0.0:1788625433.356381:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274304 00000100:00100000:2.0:1788625433.356382:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273024 00000100:00100000:2.0:1788625433.356383:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273024 00000100:00100000:0.0:1788625433.356383:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274304 00000100:00100000:2.0:1788625433.356393:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273536 00000100:00100000:2.0:1788625433.356396:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273536 00000100:00100000:2.0:1788625433.356422:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625433.356430:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206273152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356479:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206273152:12345-0@lo:400:kworker.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356486:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625433.356504:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625433.356509:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206273664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356555:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206273664:12345-0@lo:400:kworker.0 Request processed in 46us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356561:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625433.356572:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625433.356577:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206273024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356604:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206273024:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356609:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625433.356620:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625433.356625:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206273536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356648:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206273536:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356654:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625433.356671:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272640 00000100:00100000:2.0:1788625433.356674:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272640 00000100:00100000:2.0:1788625433.356707:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274432 00000100:00100000:2.0:1788625433.356710:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274432 00000100:00100000:2.0:1788625433.356722:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625433.356727:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206272640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788625433.356758:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788625433.356801:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206272640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356807:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625433.356818:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625433.356824:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206274432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625433.356833:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788625433.356861:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206274432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.356866:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625433.356898:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206273024:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356909:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206273536:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356922:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206272640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625433.356931:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.356938:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206273664:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.356938:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273920 00000100:00100000:0.0:1788625433.356947:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273920 00000100:00100000:0.0:1788625433.356966:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274176 00000100:00100000:0.0:1788625433.356968:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274176 00000100:00100000:2.0:1788625433.356980:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206274432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625433.356980:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274048 00000100:00100000:0.0:1788625433.356982:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274048 00000100:00100000:0.0:1788625433.356994:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788625433.356999:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206273280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.357021:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625433.357028:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625433.357192:0:17240:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788625433.357202:0:17240:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1788625433.357223:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788625433.357229:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788625433.357230:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625433.357232:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625433.357347:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788625433.357355:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206274304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625433.357396:0:17232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272768 00000100:00100000:3.0:1788625433.357401:0:17232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272768 00000100:00100000:3.0:1788625433.357433:0:17232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788625433.357440:0:17232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206272768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.357840:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206273792:12345-0@lo:400:kworker.0 Request processed in 810us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.357848:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625433.357866:0:18690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625433.357883:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788625433.357891:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206273920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.357924:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987441fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206273920:12345-0@lo:400:kworker.0 Request processed in 34us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.357930:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788625433.357941:0:18690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625433.357948:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788625433.357954:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206274176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358000:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206274176:12345-0@lo:400:kworker.0 Request processed in 47us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.358006:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788625433.358026:0:18690:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625433.358033:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625433.358038:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206274048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358068:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206274048:12345-0@lo:400:kworker.0 Request processed in 30us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.358074:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625433.358144:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206274560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625433.358179:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625433.358214:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274560 00000100:00100000:2.0:1788625433.358219:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274560 00000100:00100000:2.0:1788625433.358422:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625433.358429:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206274560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788625433.358455:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625433.358537:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206274560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.358555:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625433.358600:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206274560:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788625433.358639:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c28380 x1875509206274048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625433.358651:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206274048:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206273920:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358706:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206273792:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358749:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206272896 00000100:00100000:2.0:1788625433.358753:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206272896 00000100:00100000:2.0:1788625433.358789:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206273408 00000100:00100000:2.0:1788625433.358793:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206273408 00000100:00100000:2.0:1788625433.358808:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788625433.358814:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358853:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206272896:12345-0@lo:400:kworker.0 Request processed in 39us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.358859:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788625433.358872:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625433.358877:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206273408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.358904:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206273408:12345-0@lo:400:kworker.0 Request processed in 28us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625433.358910:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625433.358939:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206272896:0@lo:400:kworker.0 00000100:00100000:2.0:1788625433.359071:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206273408:0@lo:400:kworker.0 00000100:00100000:0.0:1788625433.363223:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206273280:12345-0@lo:400:kworker.0 Request processed in 6209us (7215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625433.363251:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788625433.363262:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206274304:12345-0@lo:400:kworker.0 Request processed in 5906us (7177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625433.363292:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625433.368502:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206273280:0@lo:400:kworker.0 00010000:00080000:2.0:1788625433.368560:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c28700 x1875509206274304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625433.368571:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788625433.370995:0:17232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998858b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206272768:12345-0@lo:400:kworker.0 Request processed in 13547us (15101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625433.371011:0:17232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788625433.371287:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206272768:0@lo:400:kworker.0 00010000:00010000:2.0:1788625433.996288:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625434.702176:0:17273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788625434.702187:0:17273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788625434.702234:0:17273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788625434.702244:0:17273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788625434.724355:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625434.724462:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185231872 00000100:00100000:1.0:1788625434.724472:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185231872 00000100:00100000:1.0:1788625434.724592:0:20265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625434.724603:0:20265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2393:x1875509185231872:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625434.724619:0:20265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625434.724639:0:20265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882171800/0x2d2e3b3f34a7b8ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e45e expref: 13 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625434.724657:0:20265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625434.724711:0:20265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:2393:x1875509185231872:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625434.724719:0:20265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625434.736760:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625434.736990:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625434.737087:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625434.737181:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185232384 00000100:00100000:3.0:1788625434.737192:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185232384 00000100:00100000:3.0:1788625434.737270:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:3.0:1788625434.737281:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+6:2390:x1875509185232384:12345-192.168.204.14@tcp:9:umount.0 00000020:00000080:3.0:1788625434.737322:0:18747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b916 00000020:00010000:3.0:1788625434.737331:0:18747:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998845926000: total 0 00000100:00080000:3.0:1788625434.737338:0:18747:0:(import.c:65:import_set_state_nolock()) ffff998845920800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625434.737386:0:18747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788625434.737683:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2577c14b-df6c-4b8f-a20a-0ae385000d2e+4:2390:x1875509185232384:12345-192.168.204.14@tcp:9:umount.0 Request processed in 403us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625434.737691:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:0.0:1788625434.738208:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185232128 00000100:00100000:0.0:1788625434.738217:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185232128 00000100:00100000:0.0:1788625434.738619:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185232000 00000100:00100000:0.0:1788625434.738626:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185232000 00000100:00100000:0.0:1788625434.738668:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:0.0:1788625434.738679:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+13:2393:x1875509185232128:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625434.738696:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625434.738721:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044600/0x2d2e3b3f34a7b98d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e545 expref: 13 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625434.738726:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:3.0:1788625434.738738:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+12:2394:x1875509185232000:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625434.738746:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625434.738760:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625434.738774:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744189c00/0x2d2e3b3f34a7b8f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e48f expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625434.738800:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:2393:x1875509185232128:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 123us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625434.738807:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000020:00010000:0.0:1788625434.738826:0:17227:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998845926000: total 0 00010000:00010000:0.0:1788625434.738830:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625434.738878:0:17227:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998845926000, canceled 0 locks, left on hash table 1. 00000100:00080000:1.0:1788625434.738880:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788625434.738917:0:17227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788625434.738921:0:17227:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788625418 -> 1788625419 00002000:00010000:0.0:1788625434.738936:0:17227:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788625418 -> 1788625419 00002000:00010000:0.0:1788625434.738938:0:17227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788625434.738959:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c35/0x2d2e3b3f34a7bc88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e625 expref: 3 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625434.739157:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625434.739194:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:2394:x1875509185232000:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 457us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625434.739202:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00010000:00010000:0.0:1788625434.739745:0:17227:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998845926000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788625434.739777:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625434.739779:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625434.739781:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625434.788362:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625434.788470:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185233280 00000100:00100000:2.0:1788625434.788482:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185233280 00000100:00100000:2.0:1788625434.788618:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:2.0:1788625434.788629:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+12:2390:x1875509185233280:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:2.0:1788625434.788688:0:18690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b901 00000020:00010000:2.0:1788625434.788706:0:18690:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99874352d800: total 0 00000100:00080000:2.0:1788625434.788711:0:18690:0:(import.c:65:import_set_state_nolock()) ffff998743528000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625434.788757:0:18690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:0.0:1788625434.789173:0:17228:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99874352d800: total 0 00010000:00010000:0.0:1788625434.789240:0:17228:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99874352d800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788625434.789322:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9988749c3f00) 00010000:00010000:0.0:1788625434.789326:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625434.789335:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21200/0x2d2e3b3f34a7bc2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e602 expref: 11 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789366:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3300) 00010000:00010000:0.0:1788625434.789369:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625434.789374:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20c00/0x2d2e3b3f34a7b9e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e553 expref: 10 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789391:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625434.789393:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788625434.789397:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4c00/0x2d2e3b3f34a7bbd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e5ed expref: 9 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789408:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625434.789412:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625434.789425:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21400/0x2d2e3b3f34a7ba27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e561 expref: 8 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789437:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998843c58900) 00010000:00010000:0.0:1788625434.789439:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788625434.789443:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998882045a00/0x2d2e3b3f34a7bc96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e62c expref: 7 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789458:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9987426d8700) 00010000:00010000:0.0:1788625434.789460:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625434.789464:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7b9cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e54c expref: 6 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789476:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9988749c3e00) 00010000:00010000:0.0:1788625434.789479:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788625434.789482:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21c00/0x2d2e3b3f34a7baac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e58b expref: 5 pid: 17239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625434.789494:0:17228:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99874352d800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788625434.789508:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625434.789510:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625434.789512:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625434.789761:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625434.790203:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2577c14b-df6c-4b8f-a20a-0ae385000d2e+3:2390:x1875509185233280:12345-192.168.204.14@tcp:39:umount.0 Request processed in 1573us (1851us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788625434.790213:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 76 00000100:00100000:1.0:1788625434.805490:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625434.805680:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185233408 00000100:00100000:2.0:1788625434.805690:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185233408 00000100:00100000:2.0:1788625434.805786:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 77 00000100:00100000:2.0:1788625434.805798:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+5:2390:x1875509185233408:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:2.0:1788625434.805831:0:20724:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b908 00000100:00080000:2.0:1788625434.805848:0:20724:0:(import.c:65:import_set_state_nolock()) ffff998872643000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625434.805927:0:20724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788625434.806170:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788625434.806312:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625434.807244:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2577c14b-df6c-4b8f-a20a-0ae385000d2e+3:2390:x1875509185233408:12345-192.168.204.14@tcp:39:umount.0 Request processed in 1443us (1760us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788625434.807256:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 77 00010000:00010000:0.0:1788625435.021928:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625435.916324:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625435.916347:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206274688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625435.916360:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206274816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625435.920041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625435.920172:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274816 00000100:00100000:1.0:1788625435.920182:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274816 00000100:00100000:1.0:1788625435.920242:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788625435.920252:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206274816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625435.920292:0:17244:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788625435.920360:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206274816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625435.920367:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625435.920433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206274816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625435.922015:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625435.922234:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274688 00000100:00100000:2.0:1788625435.922243:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274688 00000100:00100000:2.0:1788625435.922315:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625435.922324:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206274688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625435.922354:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788625435.922420:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625435.929860:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206274688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7525us (7837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625435.929876:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625435.930401:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206274688:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788625436.044166:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625436.329743:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625436.329795:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625436.329872:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185233536 00000100:00100000:0.0:1788625436.329883:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185233536 00000100:00100000:2.0:1788625436.329884:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185233664 00000100:00100000:2.0:1788625436.329892:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185233664 00000100:00100000:0.0:1788625436.329956:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625436.329967:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+11:2392:x1875509185233536:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625436.329984:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625436.330005:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882171200/0x2d2e3b3f34a7b92b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ce expref: 11 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625436.330034:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625436.330093:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+10:2392:x1875509185233536:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625436.330100:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625436.330118:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625436.330124:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+9:2392:x1875509185233664:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625436.330132:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625436.330141:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188000/0x2d2e3b3f34a7b932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e4ff expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625436.330149:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625436.330167:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:2392:x1875509185233664:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625436.330173:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625436.345438:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625436.345677:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185233792 00000100:00100000:1.0:1788625436.345689:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185233792 00000100:00100000:1.0:1788625436.345790:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:1.0:1788625436.345804:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+8:2394:x1875509185233792:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625436.345828:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625436.345857:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188a00/0x2d2e3b3f34a7b971 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e53e expref: 8 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625436.345874:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625436.345928:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+7:2394:x1875509185233792:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 128us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625436.345936:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:1.0:1788625436.346879:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625436.346953:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234048 00000100:00100000:2.0:1788625436.346960:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234048 00000100:00100000:2.0:1788625436.347015:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 78 00000100:00100000:2.0:1788625436.347024:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+6:2390:x1875509185234048:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:2.0:1788625436.347066:0:17240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b940 00000020:00010000:2.0:1788625436.347075:0:17240:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998872646000: total 0 00000100:00080000:2.0:1788625436.347080:0:17240:0:(import.c:65:import_set_state_nolock()) ffff998872640800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625436.347104:0:17240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1788625436.347243:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2390:x1875509185234048:12345-192.168.204.14@tcp:39:umount.0 Request processed in 206us (354us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788625436.347251:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 78 00000020:00010000:0.0:1788625436.347474:0:17228:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998872646000: total 0 00010000:00010000:0.0:1788625436.347480:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625436.347586:0:17228:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998872646000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788625436.347626:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988749c3500) 00010000:00010000:0.0:1788625436.347649:0:17228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788625436.347658:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998859be8200/0x2d2e3b3f34a7ba35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e568 expref: 4 pid: 18690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625436.347689:0:17228:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998872646000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788625436.347709:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625436.347711:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625436.347712:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625436.347910:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625436.358088:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625436.358265:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234176 00000100:00100000:2.0:1788625436.358291:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234176 00000100:00100000:2.0:1788625436.358451:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 79 00000100:00100000:2.0:1788625436.358476:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+5:2390:x1875509185234176:12345-192.168.204.14@tcp:39:umount.0 00000020:00000080:2.0:1788625436.358596:0:18690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b947 00000100:00080000:2.0:1788625436.358607:0:18690:0:(import.c:65:import_set_state_nolock()) ffff99887b478800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788625436.358659:0:18690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788625436.358965:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eda7774-83ed-48ae-a4ab-ef06595559f2+3:2390:x1875509185234176:12345-192.168.204.14@tcp:39:umount.0 Request processed in 489us (903us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788625436.359017:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 79 00010000:00010000:3.0:1788625436.359492:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625436.359554:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625436.388152:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625436.388271:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234432 00000100:00100000:2.0:1788625436.388283:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234432 00000100:00100000:2.0:1788625436.388351:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 173 00000100:00100000:2.0:1788625436.388363:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+7:2390:x1875509185234432:12345-192.168.204.14@tcp:251:umount.0 00000020:00000080:2.0:1788625436.388415:0:17234:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b8de 00000020:00010000:2.0:1788625436.388424:0:17234:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99874352d000: total 0 00000100:00080000:2.0:1788625436.388429:0:17234:0:(import.c:65:import_set_state_nolock()) ffff99874352e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788625436.388510:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd7b606b-b43c-4a41-a068-dadb9e3a4424+3:2390:x1875509185234432:12345-192.168.204.14@tcp:251:umount.0 Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625436.388548:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 173 00000020:00010000:1.0:1788625436.388789:0:17228:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99874352d000: total 0 00010000:00010000:1.0:1788625436.388847:0:17228:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99874352d000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788625436.388884:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882171c00/0x2d2e3b3f34a7b8e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e457 expref: 2 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625436.388899:0:17228:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99874352d000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788625436.388909:0:17228:0:(genops.c:885:class_export_put()) final put ffff99874352d000/dd7b606b-b43c-4a41-a068-dadb9e3a4424 00010000:00010000:1.0:1788625436.388929:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625436.388932:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625436.388933:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788625436.389030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99874352d000/dd7b606b-b43c-4a41-a068-dadb9e3a4424 for MGS 00000020:00000080:0.0:1788625436.389068:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99874352e000 for MGS 00000100:00100000:3.0:1788625436.428057:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625436.428093:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206274944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625436.428278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625436.428804:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206274944 00000100:00100000:2.0:1788625436.428813:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206274944 00000100:00100000:2.0:1788625436.428866:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625436.428877:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206274944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625436.428915:0:17978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625436.429038:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206274944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625436.429045:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788625436.429192:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206274944:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788625437.070857:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625437.200940:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788625438.095306:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625438.196899:0:20811:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788625438.216633:0:20811:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788625438.216712:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.216727:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.216733:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.216740:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.216758:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788625438.216763:0:20811:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788625438.216991:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625438.216998:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.217006:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625438.217009:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.217018:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625438.217024:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625438.217029:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788625438.217037:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788625438.217039:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788625438.217088:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.217095:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625438.217128:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.217136:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9e00/0x2d2e3b3f34a7b4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4a8 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.217146:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625438.217148:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625438.217150:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625438.217158:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625438.217176:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206275072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625438.217246:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625438.217314:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275072 00000100:00100000:0.0:1788625438.217321:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275072 00000100:00100000:0.0:1788625438.217369:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788625438.217954:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625438.217960:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788625438.217966:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788625438.217983:0:20811:0:(import.c:65:import_set_state_nolock()) ffff99887ca79000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788625438.218107:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206275200:0@lo:39:umount.0 00000100:00100000:3.0:1788625438.218155:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625438.218835:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872678c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3636:x1875509206275072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625438.218852:0:17224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625438.218875:0:17224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4e00/0x2d2e3b3f34a7b4a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4a1 expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625438.218891:0:17224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625438.218958:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872678c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:3636:x1875509206275072:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625438.219040:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3636:1875509206275072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625438.220149:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275200 00000100:00100000:1.0:1788625438.220166:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275200 00000100:00100000:1.0:1788625438.220239:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788625438.220251:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875509206275200:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788625438.220291:0:20724:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b4d2 00000100:00080000:1.0:1788625438.220306:0:20724:0:(import.c:65:import_set_state_nolock()) ffff998848849000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788625438.220433:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1875509206275200:12345-0@lo:39:umount.0 Request processed in 185us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625438.220440:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1788625438.220453:0:20724:0:(genops.c:885:class_export_put()) final put ffff99887ca7d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788625438.220481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625438.220644:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998848849000 for lustre-MDT0000 00000100:00100000:0.0:1788625438.220645:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788625438.220857:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca79000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788625438.220876:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625438.220884:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206275200:0@lo:39:umount.0 00000100:00080000:1.0:1788625438.220950:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625438.220954:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788625438.220960:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788625438.222564:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222582:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222588:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222594:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222622:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625438.222628:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222634:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222639:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222645:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222665:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625438.222695:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222702:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222707:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222713:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222720:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788625438.222724:0:20811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222730:0:20811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222736:0:20811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222741:0:20811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625438.222748:0:20811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788625438.222751:0:20811:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788625438.222779:0:20811:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788625438.222783:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788625438.222787:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625438.222792:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788625438.222803:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99887b49a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625438.222809:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99887ca95000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625438.222813:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998851cfb800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625438.222818:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99887b47c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625438.222826:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998872646000 3eda7774-83ed-48ae-a4ab-ef06595559f2 192.168.204.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788625438.222830:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99874352d800 2577c14b-df6c-4b8f-a20a-0ae385000d2e 192.168.204.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:1.0:1788625438.222834:0:20811:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9988449d3380) has exports, disconnecting them 00000020:00080000:1.0:1788625438.222838:0:20811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99887b49a800), last request at 1788625433 00000020:00000080:1.0:1788625438.222844:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b709 00000100:00080000:1.0:1788625438.222865:0:20811:0:(import.c:65:import_set_state_nolock()) ffff99887b49e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788625438.222918:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b49a800): rc 0 00000020:00000080:1.0:1788625438.222921:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887b49a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788625438.222946:0:20811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99887ca95000), last request at 1788625433 00000020:00000080:1.0:1788625438.222950:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b66f 00000100:00080000:1.0:1788625438.222956:0:20811:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788625438.222962:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca95000): rc 0 00000020:00000080:1.0:1788625438.222964:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887ca95000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788625438.222968:0:20811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998851cfb800), last request at 1788625364 00000020:00000080:1.0:1788625438.222970:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b5c0 00000100:00080000:1.0:1788625438.222973:0:20811:0:(import.c:65:import_set_state_nolock()) ffff998852348000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788625438.222978:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998851cfb800): rc 0 00000020:00000080:1.0:1788625438.222979:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cfb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788625438.222982:0:20811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99887b47c000), last request at 1788625364 00000020:00000080:3.0:1788625438.222985:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788625438.222985:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b557 00000100:00080000:1.0:1788625438.222987:0:20811:0:(import.c:65:import_set_state_nolock()) ffff99887b47e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625438.222994:0:20811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00000080:3.0:1788625438.223032:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca95000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788625438.223049:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cfb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788625438.223070:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b49e000 for lustre-MDT0000 00000020:00080000:1.0:1788625438.223073:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b47c000): rc 0 00000020:00000080:3.0:1788625438.223074:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887ca90800 for lustre-MDT0000 00000020:00000080:3.0:1788625438.223077:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998852348000 for lustre-MDT0000 00000004:00000080:1.0:1788625438.223078:0:20811:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6ab0181bae0 00000100:00080000:1.0:1788625438.223097:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788625438.223101:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788625438.223869:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788625438.223898:0:20811:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788625438.223965:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275328:0@lo:39:umount.0 00000100:00100000:3.0:1788625438.224041:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788625438.224049:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625438.224052:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788625438.224062:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625438.224095:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275328 00000100:00100000:3.0:1788625438.224103:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275328 00000100:00080000:1.0:1788625438.224115:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788625438.224125:0:20811:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788625438.224134:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625438.224137:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788625438.224143:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625438.224147:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625438.224157:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206275328:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788625438.224184:0:17244:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b5ea 00000100:00080000:3.0:1788625438.224191:0:17244:0:(import.c:65:import_set_state_nolock()) ffff998743b72800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788625438.224200:0:20811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000001:00000004:3.0:1788625438.224205:0:17244:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:1.0:1788625438.224207:0:20811:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788625438.224244:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9988449d3380) has no exports 00000100:00100000:3.0:1788625438.224311:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1875509206275328:12345-0@lo:39:umount.0 Request processed in 155us (270us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788625438.224319:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788625438.224338:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275456:0@lo:9:umount.0 00000100:00100000:3.0:1788625438.224361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625438.224380:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275584:0@lo:9:umount.0 00000100:00100000:3.0:1788625438.224400:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625438.224431:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988449c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788625438.224437:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275328:0@lo:39:umount.0 00000100:00100000:3.0:1788625438.224455:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275456 00000100:00100000:3.0:1788625438.224467:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275456 00000100:00100000:3.0:1788625438.224500:0:19761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275584 00000100:00100000:3.0:1788625438.224503:0:19761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275584 00000100:00100000:3.0:1788625438.224545:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625438.224554:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206275456:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788625438.224567:0:19761:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b748 00000100:00080000:3.0:1788625438.224573:0:19761:0:(import.c:65:import_set_state_nolock()) ffff9987426b2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788625438.224599:0:19761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788625438.224699:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3634:x1875509206275456:12345-0@lo:9:umount.0 Request processed in 148us (336us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625438.224702:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1788625438.224706:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1788625438.224710:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625438.224717:0:19761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788625438.224719:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4a00 already unused, calling callback (ffffffffc13d7c20) 00000100:00100000:3.0:1788625438.224722:0:19761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3634:x1875509206275584:12345-0@lo:9:umount.0 10000000:00010000:2.0:1788625438.224724:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788625438.224732:0:19761:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b74f 00010000:00010000:2.0:1788625438.224734:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788625438.224737:0:19761:0:(import.c:65:import_set_state_nolock()) ffff9987426b3000 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1788625438.224741:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625438.224746:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625438.224750:0:17228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788625438.224752:0:17228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000001:00000004:3.0:1788625438.224763:0:19761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00010000:00010000:2.0:1788625438.224776:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224782:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625438.224800:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224807:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4a00/0x2d2e3b3f34a7b3f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3f9 expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224818:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625438.224821:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224834:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625438.224837:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224843:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625438.224848:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625438.224854:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625438.224856:0:17228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788625438.224857:0:17228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788625438.224871:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224877:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625438.224894:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224900:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9a00/0x2d2e3b3f34a7b73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b741 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224910:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625438.224915:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224920:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625438.224922:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224934:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625438.224952:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625438.224957:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788625438.224959:0:17228:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788625438.224961:0:17228:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788625438.224974:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224979:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625438.224985:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.224990:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998882170c00/0x2d2e3b3f34a7b9a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9b0 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225000:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625438.225003:0:17228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225008:0:17228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625438.225011:0:17228:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225016:0:17228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625438.225031:0:17228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625438.225036:0:17228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625438.225038:0:17228:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788625438.225039:0:17228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788625438.225052:0:17228:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225056:0:17228:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625438.225061:0:17228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225068:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7b3e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b3eb expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225077:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625438.225079:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625438.225080:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625438.225115:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206275840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.225152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.225190:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625438.225196:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206275968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.225215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.225245:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275840 00000100:00100000:2.0:1788625438.225250:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275840 00000100:00100000:2.0:1788625438.225283:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275968 00000100:00100000:2.0:1788625438.225286:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275968 00000100:00100000:2.0:1788625438.225306:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625438.225319:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+24:3637:x1875509206275840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625438.225330:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625438.225344:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7b741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b73a expref: 24 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225357:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625438.225601:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+23:3637:x1875509206275840:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625438.225609:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625438.225627:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625438.225634:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:3637:x1875509206275968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625438.225642:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625438.225651:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682c00/0x2d2e3b3f34a7b9b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b9a9 expref: 22 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225660:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625438.225693:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3637:x1875509206275968:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625438.225700:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625438.225724:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206276096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.225749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.225768:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625438.225773:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206275712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.225791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.225811:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276096 00000100:00100000:2.0:1788625438.225814:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276096 00000100:00100000:2.0:1788625438.225833:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206275712 00000100:00100000:2.0:1788625438.225843:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206275712 00000100:00100000:2.0:1788625438.225859:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625438.225865:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+22:3635:x1875509206276096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625438.225872:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625438.225880:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188800/0x2d2e3b3f34a7b3eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3e4 expref: 22 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225888:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625438.225913:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+21:3635:x1875509206276096:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625438.225918:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625438.225930:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625438.225936:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+20:3635:x1875509206275712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788625438.225954:0:17225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625438.225962:0:17225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be8e00/0x2d2e3b3f34a7b3f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3f2 expref: 20 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625438.225974:0:17225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625438.225993:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3635:x1875509206275712:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625438.225998:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625438.226030:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206275712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.226037:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206276096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.226059:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206275968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625438.226066:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206275840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625438.226270:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625438.226773:0:19761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3634:x1875509206275584:12345-0@lo:9:umount.0 Request processed in 2048us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625438.226783:0:19761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788625438.226805:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625438.226811:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625438.226844:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998844cd0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788625438.226864:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788625438.226867:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625438.226870:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275456:0@lo:9:umount.0 00000100:00080000:3.0:1788625438.226883:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998874b50000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788625438.226970:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788625438.227074:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788625438.227078:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206275584:0@lo:9:umount.0 00000020:00080000:1.0:1788625438.233762:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9988449d3380) has no exports 00000020:00000080:1.0:1788625438.281610:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b43f 00000020:00000080:1.0:1788625438.281627:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887ca7b800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788625438.281647:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788625438.281690:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788625438.281818:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625438.281830:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625438.281834:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99887b48cd40) has no exports 00000020:00000080:0.0:1788625438.282256:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b438 00000020:00000080:0.0:1788625438.282262:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788625438.282315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788625438.282414:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625438.282422:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788625438.282425:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf5800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788625438.282427:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788625438.282434:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1788625438.475930:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625438.475956:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206276224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625438.476038:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625438.476103:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276224 00000100:00100000:1.0:1788625438.476110:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276224 00000100:00100000:1.0:1788625438.476171:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625438.476181:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206276224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625438.476214:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625438.476278:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206276224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625438.476286:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625438.476337:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206276224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625438.476438:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206276736:0@lo:400:kworker.0 00000100:00100000:1.0:1788625438.476467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625438.476488:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788625438.476493:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206276608:0@lo:400:kworker.0 00000100:00100000:1.0:1788625438.476514:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625438.476554:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206277120:0@lo:400:kworker.0 00000100:00100000:1.0:1788625438.476575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625438.476604:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276736 00000100:00100000:1.0:1788625438.476608:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276736 00000100:00100000:1.0:1788625438.476630:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276608 00000100:00100000:1.0:1788625438.476632:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276608 00000100:00100000:1.0:1788625438.476647:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277120 00000100:00100000:1.0:1788625438.476650:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277120 00000100:00100000:1.0:1788625438.476665:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625438.476672:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206277120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625438.476905:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206277120:12345-0@lo:400:kworker.0 Request processed in 232us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625438.476912:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625438.476927:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625438.476931:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875509206276736:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788625438.476937:0:17239:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788625438.476963:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875509206276736:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788625438.476981:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788625438.476995:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788625438.477000:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875509206276608:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788625438.477005:0:17239:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788625438.477028:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1875509206276608:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788625438.477034:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788625438.477066:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788625438.477071:0:3636:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788625438.477075:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788625438.479103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206276480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.479261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.479305:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.479331:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.479360:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788625438.479367:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.479391:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.479410:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206276864:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.479430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.479463:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276352 00000100:00100000:2.0:1788625438.479471:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276352 00000100:00100000:2.0:1788625438.479510:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625438.479533:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875509206276352:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788625438.479542:0:17245:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788625438.479580:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875509206276352:12345-0@lo:400:kworker.0 Request processed in 63us (188us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788625438.479586:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788625438.479621:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788625438.479626:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788625438.479630:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788625438.479636:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625438.479640:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:2.0:1788625438.479646:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625438.479673:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844359f80 x1875509206277248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625438.479707:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.479740:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276992 00000100:00100000:2.0:1788625438.479743:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276992 00000100:00100000:2.0:1788625438.479762:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276864 00000100:00100000:2.0:1788625438.479765:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276864 00000100:00100000:2.0:1788625438.479787:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788625438.479805:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206276864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.480373:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206276864:12345-0@lo:400:kworker.0 Request processed in 567us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625438.480381:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788625438.480397:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788625438.480401:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875509206276992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788625438.480407:0:20724:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788625438.480430:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1875509206276992:12345-0@lo:400:kworker.0 Request processed in 27us (1098us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788625438.480435:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788625438.480468:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988442a7800 x1875509206276864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625438.480481:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206276864:0@lo:400:kworker.0 00000100:00080000:2.0:1788625438.480490:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788625438.480494:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788625438.480498:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788625438.480502:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625438.480505:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 514 00000100:00080000:2.0:1788625438.480510:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887b49b000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625438.480548:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844358a80 x1875509206277376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625438.480568:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788625438.480603:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206277248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788625438.480632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.480652:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206277376:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788625438.480673:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625438.480712:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277376 00000100:00100000:2.0:1788625438.480716:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277376 00000100:00100000:2.0:1788625438.480736:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788625438.480741:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206277376:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788625438.480754:0:20724:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788625438.481230:0:18746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206276480 00000100:00100000:3.0:1788625438.481237:0:18746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206276480 00000100:00100000:3.0:1788625438.481279:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625438.481288:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206276480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625438.481347:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206276480:12345-0@lo:400:kworker.0 Request processed in 61us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625438.481354:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788625438.481377:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788625438.481382:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625438.481385:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625438.481420:0:17978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277248 00000100:00100000:3.0:1788625438.481424:0:17978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277248 00000100:00100000:3.0:1788625438.481443:0:17978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625438.481448:0:17978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875509206277248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788625438.481458:0:17978:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788625438.483266:0:17978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875509206277248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1806us (2622us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625438.483281:0:17978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625438.483380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206276480:0@lo:400:kworker.0 00000100:00080000:3.0:1788625438.483437:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625438.483442:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625438.483446:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206277248:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788625438.499068:0:3636:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625438.499080:0:3636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788625438.499090:0:3636:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998741e09000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625438.499133:0:3636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a7100 x1875509206277504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625438.499227:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206277504:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788625438.499301:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625438.499437:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206276608:0@lo:400:kworker.0 00010000:00080000:1.0:1788625438.499465:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9988442a5f80 x1875509206277120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625438.499487:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206277120:0@lo:400:kworker.0 00000100:00080000:1.0:1788625438.499502:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788625438.499506:0:3636:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788625438.499509:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788625438.499513:0:3636:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625438.499549:0:3636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1788625438.499554:0:3636:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998742cf4000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625438.500088:0:17239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277504 00000100:00100000:0.0:1788625438.500096:0:17239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277504 00000100:00100000:0.0:1788625438.500137:0:17239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625438.500145:0:17239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206277504:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788625438.500162:0:17239:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788625438.500218:0:17239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206277504:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 72us (916us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788625438.500226:0:17239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625438.500274:0:3636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a86300 x1875509206277632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625438.500287:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206276736:0@lo:400:kworker.0 00000100:00100000:3.0:1788625438.500475:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206277632:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788625438.500655:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625438.500815:0:18690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277632 00000100:00100000:0.0:1788625438.500820:0:18690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277632 00000100:00100000:0.0:1788625438.500852:0:18690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788625438.500858:0:18690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206277632:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788625438.500868:0:18690:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788625438.500975:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788625438.500980:0:18690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206277632:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 119us (322us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788625438.500982:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625438.500986:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206277632:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788625438.500999:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788625438.501000:0:18690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788625438.501007:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625438.501011:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206277504:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788625438.516243:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206277376:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35491us (35560us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625438.516258:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788625438.516570:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625438.516577:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625438.516580:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206277376:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1788625439.116629:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625440.139985:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625441.036319:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625441.036341:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206277760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625441.036637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1788625441.037937:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788625441.037944:0:19558:0:(genops.c:885:class_export_put()) final put ffff9987426b1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788625441.037963:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000020:00000080:3.0:1788625441.037965:0:19558:0:(genops.c:885:class_export_put()) final put ffff998845926000/2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000100:00100000:2.0:1788625441.039951:0:18748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277760 00000100:00100000:2.0:1788625441.039980:0:18748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277760 00000020:00000080:1.0:1788625441.040171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9987426b1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788625441.040237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998845926000/2577c14b-df6c-4b8f-a20a-0ae385000d2e for lustre-OST0001 00000020:00000080:1.0:1788625441.040260:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987426b3000 for lustre-OST0001 00000020:00000080:1.0:1788625441.040269:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998845920800 for lustre-OST0001 00000100:00100000:2.0:1788625441.040407:0:18748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625441.040419:0:18748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206277760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625441.040452:0:18748:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625441.040613:0:18748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998742c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206277760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 196us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625441.040620:0:18748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788625441.040885:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625441.040896:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206277760:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788625441.042572:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788625441.042580:0:17219:0:(genops.c:885:class_export_put()) final put ffff99887b47c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788625441.042612:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00080000:2.0:1788625441.042641:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1788625441.042645:0:17219:0:(genops.c:885:class_export_put()) final put ffff998872646000/3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:2.0:1788625441.042652:0:17219:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000001:00080000:2.0:1788625441.042656:0:17219:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1788625441.042658:0:17219:0:(genops.c:885:class_export_put()) final put ffff99874352d800/2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000020:00000080:3.0:1788625441.042723:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788625441.042779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998872646000/3eda7774-83ed-48ae-a4ab-ef06595559f2 for lustre-MDT0000 00000020:00000080:3.0:1788625441.042805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99874352d800/2577c14b-df6c-4b8f-a20a-0ae385000d2e for lustre-MDT0000 00000020:00000080:3.0:1788625441.042830:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b47e800 for lustre-MDT0000 00000020:00000080:3.0:1788625441.042835:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998872640800 for lustre-MDT0000 00000020:00000080:3.0:1788625441.042838:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998743528000 for lustre-MDT0000 00000001:00100000:0.0:1788625441.045960:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788625441.045975:0:17970:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788625441.045980:0:17970:0:(genops.c:885:class_export_put()) final put ffff998743b74800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788625441.046005:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00080000:0.0:1788625441.046011:0:17970:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788625441.046013:0:17970:0:(genops.c:885:class_export_put()) final put ffff99887b47e000/3eda7774-83ed-48ae-a4ab-ef06595559f2 00000001:00100000:0.0:1788625441.046018:0:17970:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000001:00080000:0.0:1788625441.046021:0:17970:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788625441.046023:0:17970:0:(genops.c:885:class_export_put()) final put ffff99874352a800/2577c14b-df6c-4b8f-a20a-0ae385000d2e 00000020:00000080:3.0:1788625441.048368:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998743b74800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788625441.048451:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47e000/3eda7774-83ed-48ae-a4ab-ef06595559f2 for lustre-MDT0001 00000020:00000080:3.0:1788625441.048477:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874352a800/2577c14b-df6c-4b8f-a20a-0ae385000d2e for lustre-MDT0001 00000020:00000080:3.0:1788625441.048511:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998743b72800 for lustre-MDT0001 00000020:00000080:3.0:1788625441.048546:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b478800 for lustre-MDT0001 00000020:00000080:3.0:1788625441.048551:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998872643000 for lustre-MDT0001 00010000:00010000:2.0:1788625441.163879:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625442.188232:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625443.214615:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625443.595762:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206277888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625443.595848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625443.596051:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206278016:0@lo:400:kworker.0 00000100:00100000:2.0:1788625443.596093:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625443.596147:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278016 00000100:00100000:2.0:1788625443.596156:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278016 00000100:00100000:2.0:1788625443.596217:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788625443.596220:0:20432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206277888 00000100:00100000:1.0:1788625443.596228:0:20432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206277888 00000100:00100000:2.0:1788625443.596229:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3638:x1875509206278016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625443.596274:0:20432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625443.596284:0:20432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206277888:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625443.596290:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:097bbbb0-568c-46a3-88ad-c1c4a94e09ad+19:3638:x1875509206278016:12345-0@lo:400:kworker.0 Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625443.596299:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00002000:00000024:1.0:1788625443.596316:0:20432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788625443.596356:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3638:1875509206278016:0@lo:400:kworker.0 00000100:00080000:2.0:1788625443.596491:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625443.597332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625443.597338:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625443.597342:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625443.597348:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788625443.597353:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625443.597358:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625443.597385:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998742c2ad80 x1875509206278144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625443.597425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625443.597429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625443.597430:0:37:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625443.597434:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788625443.597437:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625443.597440:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998741e09000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625443.597451:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998742c2b480 x1875509206278400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625443.597460:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625443.597463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625443.597465:0:37:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625443.597477:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788625443.597480:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625443.597483:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998742cf4000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625443.597494:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998742c29500 x1875509206278528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625443.597509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625443.597512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625443.597514:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625443.597532:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788625443.597535:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625443.597539:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887b49b000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625443.597548:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743832300 x1875509206278784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625443.597665:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206278144:0@lo:38:kworker.0 00000100:00100000:3.0:1788625443.597725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597754:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206278400:0@lo:38:kworker.0 00000100:00100000:3.0:1788625443.597778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597792:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206278528:0@lo:38:kworker.0 00000100:00100000:3.0:1788625443.597809:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597825:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206278784:0@lo:38:kworker.0 00000100:00100000:3.0:1788625443.597844:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597874:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206278656:0@lo:400:kworker.0 00000100:00100000:3.0:1788625443.597898:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597917:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625443.597930:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206278272:0@lo:400:kworker.0 00000100:00100000:3.0:1788625443.597955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.597980:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625443.597987:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206278912:0@lo:400:kworker.0 00000100:00100000:3.0:1788625443.598008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625443.598032:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278144 00000100:00100000:3.0:1788625443.598038:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278144 00000100:00100000:3.0:1788625443.598066:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788625443.598072:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206278144:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788625443.598087:0:17244:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788625443.602711:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278400 00000100:00100000:2.0:1788625443.602729:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278400 00000100:00100000:2.0:1788625443.602769:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278528 00000100:00100000:2.0:1788625443.602772:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278528 00000100:00100000:2.0:1788625443.602781:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278784 00000100:00100000:2.0:1788625443.602783:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278784 00000100:00100000:2.0:1788625443.602790:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278656 00000100:00100000:2.0:1788625443.602793:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278656 00000100:00100000:2.0:1788625443.602830:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278912 00000100:00100000:2.0:1788625443.602833:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278912 00000100:00100000:2.0:1788625443.602854:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788625443.602865:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206278656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625443.602999:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206278656:12345-0@lo:400:kworker.0 Request processed in 136us (5099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625443.603007:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788625443.603026:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788625443.603033:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625443.603069:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206278912:12345-0@lo:400:kworker.0 Request processed in 37us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625443.603075:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788625443.603088:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625443.603093:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278400:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788625443.603109:0:20724:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788625443.603144:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278400:12345-0@lo:38:kworker.0 Request processed in 50us (5366us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625443.603591:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788625443.603971:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625443.603977:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278528:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788625443.603989:0:20724:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788625443.604034:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278528:12345-0@lo:38:kworker.0 Request processed in 56us (6223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625443.604040:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625443.604050:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788625443.604054:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278784:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788625443.604061:0:20724:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788625443.604084:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206278784:12345-0@lo:38:kworker.0 Request processed in 27us (6238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625443.604089:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788625443.604233:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788625443.604765:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743830000 x1875509206278912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625443.604783:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206278912:0@lo:400:kworker.0 00000100:00080000:2.0:1788625443.604827:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625443.604833:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788625443.604836:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206278400:0@lo:38:kworker.0 00000100:00080000:2.0:1788625443.604846:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625443.604849:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788625443.604852:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206278528:0@lo:38:kworker.0 00000100:00080000:2.0:1788625443.604860:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788625443.604863:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788625443.604866:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206278784:0@lo:38:kworker.0 00000100:00100000:2.0:1788625443.604954:0:18745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206278272 00000100:00100000:2.0:1788625443.604960:0:18745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206278272 00000100:00100000:2.0:1788625443.605005:0:18745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788625443.605011:0:18745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206278272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625443.605056:0:18745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206278272:12345-0@lo:400:kworker.0 Request processed in 46us (7101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625443.605062:0:18745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788625443.605081:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625443.605117:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206278272:0@lo:400:kworker.0 00010000:00080000:2.0:1788625443.605131:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998742c2bb80 x1875509206278656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625443.605541:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206278656:0@lo:400:kworker.0 00000001:00100000:2.0:1788625443.605739:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625443.605749:0:18741:0:(genops.c:885:class_export_put()) final put ffff9987426b6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788625443.605795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9987426b6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788625443.605900:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987426b2000 for lustre-OST0000 00000100:00100000:1.0:1788625443.608435:0:20432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206277888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12143us (12577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625443.608451:0:20432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625443.610466:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206277888:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788625443.621019:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625443.621033:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788625443.621038:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998742c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206278144:0@lo:38:kworker.0 00000100:00100000:3.0:1788625443.621090:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206278144:12345-0@lo:38:kworker.0 Request processed in 23013us (23360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625443.621103:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788625444.236279:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788625444.363692:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9988464e4240 - data ffff998867a6ebd0/ffff99886cbb2000 00000020:01000000:2.0:1788625444.363909:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9987426be2a0 - data ffff998848effa20/ffff99887d864800 00000001:00000004:2.0:1788625444.369958:0:20811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:0.0:1788625444.440238:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625444.440250:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788625444.440265:0:20811:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9988442a4000 x1875509206275328/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788625448 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625444.440315:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788625444.443316:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788625444.443327:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788625444.443356:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788625444.443359:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788625444.443900:0:17263:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788625444.443909:0:17263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788625444.443924:0:17263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788625444.444682:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788625444.444687:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788625444.444702:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788625444.444705:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788625444.445773:0:17265:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788625444.445779:0:17265:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788625444.445790:0:17265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788625444.451428:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b407 00000020:00000080:0.0:1788625444.451445:0:20811:0:(genops.c:885:class_export_put()) final put ffff9988449cc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625444.452955:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788625444.464053:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b41c 00000020:00000080:1.0:1788625444.464070:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887b479800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788625444.464089:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788625444.464094:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625444.464104:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788625444.464108:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9988449d19c0) has no exports 00000004:01000000:1.0:1788625444.464288:0:20811:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788625444.464299:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b47e 00000020:00000080:1.0:1788625444.464303:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887ca7f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788625444.464307:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788625444.464321:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625444.464326:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625444.464329:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99887b488000) has no exports 00000020:00000080:1.0:1788625444.464335:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b477 00000020:00000080:1.0:1788625444.464338:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf1800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788625444.464717:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788625444.464722:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625444.464726:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788625444.464731:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625444.464733:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625444.464761:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625444.464766:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625444.464770:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b469 00000020:00000080:1.0:1788625444.464775:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887f88b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788625444.464778:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788625444.464781:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625444.464785:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625444.464787:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff998742ed0000) has no exports 00000020:00000080:1.0:1788625444.464791:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b462 00000020:00000080:1.0:1788625444.464793:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887f888000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788625444.465098:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788625444.465102:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625444.465104:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788625444.465108:0:20811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625444.465110:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625444.465132:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625444.465137:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788625444.465145:0:20811:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788625444.465149:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b454 00000020:00000080:1.0:1788625444.465153:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788625444.465156:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788625444.465159:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625444.465169:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625444.465171:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff99887b48b380) has no exports 00000020:00000080:1.0:1788625444.465174:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b44d 00000020:00000080:1.0:1788625444.465177:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788625444.466213:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b479800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788625444.466233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788625444.466239:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788625444.466246:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998874b50000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788625444.466281:0:37:0:(genops.c:885:class_export_put()) final put ffff99887f889000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625444.466284:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f889000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788625444.466289:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466409:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f88b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788625444.466416:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887f888000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788625444.466422:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998844cd0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788625444.466428:0:37:0:(genops.c:885:class_export_put()) final put ffff998851cf3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625444.466429:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788625444.466433:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466467:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788625444.466473:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788625444.466503:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788625444.466540:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625444.466545:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625444.466552:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625444.466583:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9988449c8800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788625444.466622:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625444.466632:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466635:0:20811:0:(genops.c:885:class_export_put()) final put ffff998851cf7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625444.466637:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff998851cf7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788625444.466642:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466703:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625444.466707:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466710:0:20811:0:(genops.c:885:class_export_put()) final put ffff9988449cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788625444.466712:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788625444.466717:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788625444.466793:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b423 00000020:00000080:0.0:1788625444.466801:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887b47f000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788625444.466810:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788625444.466818:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788625444.466827:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625444.466832:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625444.466834:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9988449d4d40) has no exports 00000020:00000080:0.0:1788625444.466853:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625444.466856:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788625444.466858:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887b47d800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788625444.466860:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788625444.466865:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788625444.466907:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b42a 00000020:00000080:0.0:1788625444.466911:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887b47f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788625444.466923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b47f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788625444.466935:0:20811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998848aae000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788625444.466947:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998848aae000 3 00000020:01000004:0.0:1788625444.466951:0:20811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998848aae000 from lustre-MDT0000 00000020:00000080:0.0:1788625444.466973:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625444.466977:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788625444.466980:0:20811:0:(genops.c:885:class_export_put()) final put ffff9988449cf800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788625444.466982:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449cf800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788625444.466989:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788625444.467017:0:20811:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788625444.467020:0:20811:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788625444.467023:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788625444.467025:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625444.467028:0:20811:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625444.467035:0:20811:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff998878126000 097bbbb0-568c-46a3-88ad-c1c4a94e09ad 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625444.467040:0:20811:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99887b4899c0) has exports, disconnecting them 00000020:00080000:0.0:1788625444.467044:0:20811:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff998878126000), last request at 1788625352 00000020:00000080:0.0:1788625444.467058:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b3cf 00000020:00010000:0.0:1788625444.467062:0:20811:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998878126000: total 0 00000100:00080000:0.0:1788625444.467065:0:20811:0:(import.c:65:import_set_state_nolock()) ffff998878125800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788625444.467077:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998878126000): rc 0 00000020:00080000:0.0:1788625444.467081:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99887b4899c0) has no exports 00000020:00010000:0.0:1788625444.467090:0:17228:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998878126000: total 0 00010000:00010000:0.0:1788625444.467093:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625444.467114:0:17228:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998878126000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788625444.467148:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744189e00/0x2d2e3b3f34a7b630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b629 expref: 14 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467165:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7b4ee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4e7 expref: 13 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467181:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1600/0x2d2e3b3f34a7b4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b4f5 expref: 12 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467207:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae1200/0x2d2e3b3f34a7b50a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b503 expref: 11 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467218:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0c00/0x2d2e3b3f34a7b3dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b3d6 expref: 10 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467226:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744188400/0x2d2e3b3f34a7b6ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6c3 expref: 9 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467235:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7b65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b653 expref: 8 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467244:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743ae0a00/0x2d2e3b3f34a7b5ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b5a4 expref: 7 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467253:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998744189800/0x2d2e3b3f34a7b6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b6ed expref: 6 pid: 17234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467267:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998859be9400/0x2d2e3b3f34a7b9a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b99b expref: 5 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467277:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4200/0x2d2e3b3f34a7b733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b72c expref: 4 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467289:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882170800/0x2d2e3b3f34a7b97f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b978 expref: 3 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467300:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998882044c00/0x2d2e3b3f34a7b994 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2d2e3b3f34a7b986 expref: 2 pid: 17232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625444.467321:0:17228:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998878126000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788625444.467335:0:17228:0:(genops.c:885:class_export_put()) final put ffff998878126000/097bbbb0-568c-46a3-88ad-c1c4a94e09ad 00010000:00010000:0.0:1788625444.467343:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625444.467345:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625444.467347:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788625444.467353:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998878126000/097bbbb0-568c-46a3-88ad-c1c4a94e09ad for MGS 00000020:00000080:0.0:1788625444.467375:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998878125800 for MGS 00000100:00100000:2.0:1788625444.467596:0:17234:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff998742d38600:17234] 2 exiting: rc = 0 00000100:00100000:2.0:1788625444.467706:0:17233:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff998742d39800:17233] 1 exiting: rc = 0 00000100:00100000:2.0:1788625444.467866:0:17232:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff998741d81600:17232] 0 exiting: rc = 1 00000100:00100000:0.0:1788625444.471638:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471650:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471657:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471663:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471668:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471673:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471681:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471686:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471692:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471697:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471703:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471708:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471713:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471718:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471723:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471729:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471735:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471740:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471746:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471752:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471768:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471774:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471779:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471784:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471790:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471815:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471820:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471825:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471832:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471837:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471845:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471849:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471854:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471861:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471866:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471872:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471876:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471881:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471886:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471890:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471895:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471900:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471904:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471909:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471915:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471920:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471925:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471930:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471934:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471940:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471945:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471951:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471956:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471961:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471967:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471973:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471979:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471985:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471990:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.471994:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.472007:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.472012:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.472018:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625444.472024:0:20811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788625444.474183:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9988464e45a0 - data ffff998848fd5000/ffff99886cbb3400 00000020:01000000:0.0:1788625444.474333:0:20811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998741e79d80 - data ffff998860026288/ffff99887dfb9800 00000020:00000080:0.0:1788625444.474827:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b3b3 00000020:00000080:0.0:1788625444.474837:0:20811:0:(genops.c:885:class_export_put()) final put ffff99874414d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788625444.474849:0:20811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998848aae000 from MGS, refs=2 00000020:01000004:0.0:1788625444.474853:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998848aae000 2 00000020:01000004:0.0:1788625444.474856:0:20811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998848aae000 from MGS 00000020:00000080:0.0:1788625444.474892:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625444.474899:0:20811:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788625444.474903:0:20811:0:(genops.c:885:class_export_put()) final put ffff998744149800/MGS 00000020:00000080:0.0:1788625444.474905:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff998744149800/MGS for MGS 00000020:01000000:0.0:1788625444.474912:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788625444.474983:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788625444.474987:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625444.474993:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625444.475001:0:20811:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9988449ca800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625444.475007:0:20811:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99887da599c0) has exports, disconnecting them 00000020:00080000:0.0:1788625444.475012:0:20811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9988449ca800), last request at 1788625352 00000020:00000080:0.0:1788625444.475017:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b4b6 00000020:00080000:0.0:1788625444.475027:0:20811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9988449ca800): rc 0 00000020:00000080:0.0:1788625444.475031:0:20811:0:(genops.c:885:class_export_put()) final put ffff9988449ca800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788625444.475813:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874414d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788625444.475823:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9988449ca800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788625444.496612:0:20811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788625444.496621:0:20811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625444.496625:0:20811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788625444.496632:0:20811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788625444.496660:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887ca79000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788625444.496833:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625444.496840:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788625444.496846:0:20811:0:(genops.c:885:class_export_put()) final put ffff99887ca7d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788625444.496849:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca7d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788625444.496857:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788625444.496944:0:20811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998848aae000 1 00000020:00000080:2.0:1788625444.496958:0:20811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b3a5 00000020:00000080:2.0:1788625444.496965:0:20811:0:(genops.c:885:class_export_put()) final put ffff99874414e000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788625444.496972:0:20811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788625444.497280:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874414e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788625444.497291:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625444.497297:0:20811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788625444.497301:0:20811:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99887cb1b380) has no exports 00000020:00000080:2.0:1788625444.584486:0:20811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625444.584509:0:20811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788625444.584692:0:20811:0:(genops.c:885:class_export_put()) final put ffff998848aae800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788625444.584697:0:20811:0:(genops.c:844:class_export_destroy()) destroying export ffff998848aae800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788625444.584710:0:20811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788625444.584898:0:20811:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998848aa8800 00000020:02000400:2.0:1788625444.584958:0:20811:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788625445.259945:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625446.156009:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788625446.164684:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206279040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625446.164779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625446.167476:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279040 00000100:00100000:2.0:1788625446.167496:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279040 00000100:00100000:2.0:1788625446.167732:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625446.167743:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206279040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625446.167780:0:18749:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625446.167915:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206279040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625446.167923:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788625446.170183:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625446.170353:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206279040:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788625446.284777:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625447.307977:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788625447.436383:0:17997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788625448.332868:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788625448.393943:0:21012:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788625448.408018:0:21012:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788625448.408078:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.408092:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.408100:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.408108:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.408135:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625448.408156:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788625448.408185:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625448.408189:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625448.408196:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625448.408204:0:21012:0:(import.c:65:import_set_state_nolock()) ffff998741e09000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625448.408210:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625448.408212:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1788625448.408295:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625448.408303:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.408359:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae0000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625448.408363:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.408372:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625448.408380:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625448.408385:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625448.408388:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788625448.408390:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788625448.408427:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625448.408492:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788625448.408883:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625448.408913:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.408921:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998743ae0000/0x2d2e3b3f34a7b5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b5ab expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.409103:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625448.409105:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625448.409107:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625448.409418:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206279168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625448.409510:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625448.411089:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411108:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411115:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411122:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411148:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625448.411155:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411161:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411166:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411187:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411197:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788625448.411204:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411210:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411215:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411221:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411230:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788625448.411234:0:21012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411240:0:21012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411246:0:21012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411252:0:21012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625448.411270:0:21012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788625448.411274:0:21012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788625448.411302:0:21012:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788625448.411633:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788625448.411639:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625448.411646:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788625448.411653:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff998742cf1000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788625448.411659:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99887b6f2000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788625448.411663:0:21012:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff998873948000) has exports, disconnecting them 00000020:00080000:3.0:1788625448.411668:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff998742cf1000), last request at 1788625443 00000020:00000080:3.0:1788625448.411675:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b71e 00000100:00080000:3.0:1788625448.411693:0:21012:0:(import.c:65:import_set_state_nolock()) ffff998742cf0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788625448.411818:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998742cf1000): rc 0 00000020:00000080:3.0:1788625448.411821:0:21012:0:(genops.c:885:class_export_put()) final put ffff998742cf1000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788625448.411832:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99887b6f2000), last request at 1788625443 00000020:00000080:3.0:1788625448.411835:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b684 00000100:00080000:3.0:1788625448.411841:0:21012:0:(import.c:65:import_set_state_nolock()) ffff99887b6f6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788625448.411920:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b6f2000): rc 0 00000020:00000080:3.0:1788625448.411922:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b6f2000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788625448.411929:0:21012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa6ab01dafae0 00000100:00080000:3.0:1788625448.411948:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625448.411952:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788625448.412424:0:20265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279168 00000100:00100000:2.0:1788625448.412433:0:20265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279168 00000100:00100000:2.0:1788625448.412475:0:20265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625448.412495:0:20265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1875509206279168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788625448.412532:0:20265:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625448 with bad export cookie 3255604723287831503 00000100:00080000:3.0:1788625448.413098:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625448.413106:0:21012:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625448.413279:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788625448.413283:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788625448.413303:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788625448.413468:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788625448.413505:0:21012:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788625448.413605:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788625448.413610:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788625448.413621:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788625448.413680:0:21012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788625448.413692:0:21012:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788625448.413829:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff998873948000) has no exports 00000020:00000080:1.0:1788625448.414319:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998742cf1000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788625448.414394:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788625448.414421:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998742cf0000 for lustre-MDT0001 00000020:00000080:1.0:1788625448.414426:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b6f6000 for lustre-MDT0001 00010000:00010000:1.0:1788625448.414439:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788625448.414448:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414460:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625448.414465:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414476:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625448.414494:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625448.414500:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625448.414502:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788625448.414505:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788625448.414550:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414557:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625448.414578:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414597:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744189200/0x2d2e3b3f34a7b503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b50a expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414610:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788625448.414614:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414619:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625448.414622:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414630:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625448.414636:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625448.414641:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625448.414643:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788625448.414645:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788625448.414658:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414664:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625448.414678:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414685:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744189600/0x2d2e3b3f34a7b72c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b733 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414711:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625448.414715:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414721:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be9800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625448.414724:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414732:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625448.414740:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625448.414746:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788625448.414748:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788625448.414749:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788625448.414763:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414768:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625448.414774:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.414780:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be9800/0x2d2e3b3f34a7b99b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b9a2 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416607:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625448.416622:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416647:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625448.416650:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416660:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625448.416667:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625448.416673:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788625448.416675:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788625448.416678:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788625448.416714:0:17227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416719:0:17227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625448.416732:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416741:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744188200/0x2d2e3b3f34a7b4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2d2e3b3f34a7b4fc expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625448.416763:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625448.416765:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625448.416767:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625448.417613:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206279680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625448.417696:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625448.417760:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788625448.417779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206279808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625448.418139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625448.419257:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206279296:0@lo:9:umount.0 00000100:00100000:1.0:1788625448.419313:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625448.419345:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206279424:0@lo:9:umount.0 00000100:00100000:1.0:1788625448.419368:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625448.419408:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279296 00000100:00100000:1.0:1788625448.419416:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279296 00000100:00100000:1.0:1788625448.419467:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279424 00000100:00100000:1.0:1788625448.419469:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279424 00000100:00100000:1.0:1788625448.419506:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625448.419538:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1875509206279296:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788625448.419569:0:18747:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b6ae 00000100:00080000:1.0:1788625448.419580:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9987427a7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788625448.419622:0:18747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1788625448.419678:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625448.419695:0:17235:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625448.419723:0:18746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625448.419736:0:18746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875509206279424:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788625448.419754:0:18746:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b756 00000100:00080000:0.0:1788625448.419762:0:18746:0:(import.c:65:import_set_state_nolock()) ffff9987426b3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788625448.419790:0:18746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788625448.419865:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3634:x1875509206279296:12345-0@lo:9:umount.0 Request processed in 349us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625448.419874:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788625448.419921:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788625448.419936:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788625448.419939:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.419942:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206279296:0@lo:9:umount.0 00000100:00080000:1.0:1788625448.419954:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998854e39000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788625448.419962:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788625448.419964:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.419966:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206279424:0@lo:9:umount.0 00010000:00010000:1.0:1788625448.420002:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625448.422120:0:18746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3634:x1875509206279424:12345-0@lo:9:umount.0 Request processed in 1318us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625448.422134:0:18746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788625448.425084:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279680 00000100:00100000:3.0:1788625448.425102:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279680 00000100:00100000:3.0:1788625448.425150:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206279808 00000100:00100000:3.0:1788625448.425154:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206279808 00000100:00100000:3.0:1788625448.425172:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625448.425180:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206279680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788625448.425189:0:17225:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625448 with bad export cookie 3255604723287831503 00000100:00100000:3.0:1788625448.425291:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206279680:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (7594us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625448.425298:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625448.425315:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625448.425319:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206279808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788625448.425323:0:17225:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788625448 with bad export cookie 3255604723287831503 00000100:00100000:3.0:1788625448.425350:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875509206279808:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (7212us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625448.425356:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788625448.425806:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788625448.425826:0:3637:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788625448.425830:0:3637:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788625448.426408:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625448.447739:0:3637:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.114@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788625448.447746:0:3637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788625448.447758:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9988442a4000 x1875509206279168/t0(0) o103->MGC192.168.204.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625464 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625448.447777:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9988442a7100 x1875509206279680/t0(0) o103->MGC192.168.204.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625464 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625448.447785:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9988442a4e00 x1875509206279808/t0(0) o103->MGC192.168.204.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788625464 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788625448.447867:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788625448.447870:0:3637:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788625448.447871:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788625448.449030:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:0:1875509206279552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625448.449615:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:0:1875509206279936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625448.449639:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3635:1875509206279168:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788625448.449720:0:20265:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875509206279168 offset 224 length 224: 4 00000100:00100000:2.0:1788625448.449742:0:20265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3635:x1875509206279168:12345-0@lo:103:ldlm_bl.0 Request processed in 37259us (40232us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788625448.449753:0:20265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788625448.450731:0:3637:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625448.450739:0:3637:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788625448.450748:0:3637:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff998878127800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625448.450866:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a7800 x1875509206280064/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625448.450924:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206280064:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788625448.450967:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206280064 offset 0 length 520: 4 00000100:00100000:1.0:1788625448.451039:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206279680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625448.451061:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3637:1875509206279808:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788625448.458226:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff998873948000) has no exports 00000020:01000000:1.0:1788625448.546677:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9988464e41e0 - data ffff9987420465e8/ffff99886cbb1400 00000020:01000000:1.0:1788625448.546851:0:21012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998843520720 - data ffff99886787c948/ffff99884419e000 00000001:00000004:1.0:1788625448.580682:0:21012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788625448.660790:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625448.660801:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625448.660811:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788625448.664324:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625448.664337:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788625448.664360:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.664380:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625448.665235:0:17979:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625448.665242:0:17979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788625448.665253:0:17979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788625448.667293:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625448.667300:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788625448.667326:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.667328:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788625448.667911:0:17981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788625448.667917:0:17981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788625448.667939:0:17981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788625448.673062:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b518 00000020:00000080:1.0:1788625448.673076:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887ca97000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788625448.673701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca97000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788625448.674162:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b52d 00000020:00000080:1.0:1788625448.674170:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b6f5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788625448.674224:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788625448.674231:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625448.674240:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788625448.674244:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99887394cd40) has no exports 00000004:01000000:1.0:1788625448.674408:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788625448.674417:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b581 00000020:00000080:1.0:1788625448.674422:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b64a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788625448.684070:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788625448.684111:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625448.684127:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625448.684133:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99884423cd40) has no exports 00000020:00000080:1.0:1788625448.684148:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b57a 00000020:00000080:1.0:1788625448.684158:0:21012:0:(genops.c:885:class_export_put()) final put ffff998854e3c800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788625448.684616:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788625448.684621:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788625448.684626:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788625448.684631:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.684634:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625448.684686:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625448.684695:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788625448.684704:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b56c 00000020:00000080:1.0:1788625448.684710:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b648800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788625448.684717:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788625448.684727:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625448.684744:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625448.684747:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99887394b380) has no exports 00000020:00000080:1.0:1788625448.684751:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b565 00000020:00000080:1.0:1788625448.684754:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b64b000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788625448.685150:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788625448.685154:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788625448.685157:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788625448.685160:0:21012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788625448.685162:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625448.685195:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625448.685199:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788625448.685212:0:21012:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788625448.685219:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b550 00000020:00000080:1.0:1788625448.685223:0:21012:0:(genops.c:885:class_export_put()) final put ffff99886c327000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788625448.685230:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788625448.685237:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625448.685240:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788625448.685243:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff998742ed3380) has no exports 00000020:00000080:1.0:1788625448.685246:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b549 00000020:00000080:1.0:1788625448.685249:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887ca95800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788625448.686659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788625448.686676:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b64a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788625448.686681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998854e3c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788625448.686688:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998854e39000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788625448.686694:0:37:0:(genops.c:885:class_export_put()) final put ffff99887b649000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788625448.686697:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b649000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788625448.686701:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788625448.686790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b648800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788625448.686796:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b64b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788625448.686801:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b64e800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788625448.686804:0:37:0:(genops.c:885:class_export_put()) final put ffff99887b64c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788625448.686806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b64c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788625448.686808:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788625448.686832:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c327000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788625448.686837:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca95800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788625448.687459:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788625448.687465:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625448.687470:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625448.687488:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625448.687587:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.687598:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625448.687625:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.687629:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625448.687633:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887ca96800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625448.687635:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca96800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788625448.687642:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788625448.687814:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b534 00000020:00000080:0.0:1788625448.687823:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b6f4800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788625448.687827:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788625448.687832:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625448.687837:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788625448.687840:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9988739499c0) has no exports 00000020:00000080:0.0:1788625448.687859:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.687862:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788625448.687867:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b53b 00000020:00000080:0.0:1788625448.687871:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887b612800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788625448.687878:0:21012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9987427c7800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788625448.687881:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427c7800 2 00000020:01000004:0.0:1788625448.687884:0:21012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9987427c7800 from lustre-MDT0001 00000020:00000080:0.0:1788625448.687908:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.687911:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788625448.687914:0:21012:0:(genops.c:885:class_export_put()) final put ffff99887ca93000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788625448.687917:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca93000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788625448.688112:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887ca92800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788625448.688119:0:37:0:(genops.c:885:class_export_put()) final put ffff9987427c2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788625448.688121:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427c2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788625448.688128:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788625448.688225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b6f4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788625448.688229:0:37:0:(genops.c:885:class_export_put()) final put ffff99887ca96000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788625448.688231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca96000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788625448.688234:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788625448.688347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b612800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788625448.688439:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788625448.688474:0:21012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788625448.688489:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788625448.688492:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625448.688497:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788625448.688504:0:21012:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff998741e08800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788625448.688509:0:21012:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99887da5b380) has exports, disconnecting them 00000020:00080000:0.0:1788625448.688632:0:21012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff998741e08800), last request at 1788625364 00000020:00000080:0.0:1788625448.688637:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b5b9 00000020:00080000:0.0:1788625448.688649:0:21012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998741e08800): rc 0 00000020:00000080:0.0:1788625448.688652:0:21012:0:(genops.c:885:class_export_put()) final put ffff998741e08800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788625448.688801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e08800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000100:00080000:3.0:1788625448.718261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625448.718281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625448.718285:0:37:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625448.718294:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1788625448.718301:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625448.718310:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998742cf4000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625448.718352:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743830e00 x1875509206280192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625448.718395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788625448.718398:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788625448.718399:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625448.718403:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1788625448.718405:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625448.718408:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887b49b000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625448.718417:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743831c00 x1875509206280448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625448.718450:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625448.718468:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788625448.718578:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625448.718626:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788625448.718635:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206280576:0@lo:400:kworker.0 00000100:00100000:3.0:1788625448.718669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625448.721899:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206280192:0@lo:38:kworker.0 00000100:00100000:3.0:1788625448.721998:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625448.722046:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206280448:0@lo:38:kworker.0 00000100:00100000:3.0:1788625448.722072:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625448.725609:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280320 00000100:00100000:3.0:1788625448.725626:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280320 00000100:00100000:3.0:1788625448.725677:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280576 00000100:00100000:3.0:1788625448.725682:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280576 00000100:00100000:3.0:1788625448.725693:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280192 00000100:00100000:3.0:1788625448.725695:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280192 00000100:00100000:3.0:1788625448.725704:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280448 00000100:00100000:3.0:1788625448.725707:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280448 00000100:00100000:3.0:1788625448.725724:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625448.725734:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875509206280320:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788625448.725744:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788625448.725847:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1875509206280320:12345-0@lo:400:kworker.0 Request processed in 112us (7267us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625448.725855:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625448.725876:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625448.725881:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875509206280576:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788625448.725887:0:17240:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788625448.725943:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875509206280576:12345-0@lo:400:kworker.0 Request processed in 60us (7273us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788625448.725950:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788625448.725963:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788625448.725967:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206280192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788625448.725991:0:17240:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625448.751388:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788625448.751405:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788625448.751431:0:20724:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625448.751576:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280448:12345-0@lo:38:kworker.0 Request processed in 172us (29501us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625448.751599:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788625448.751655:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788625448.751660:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625448.751663:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:01000000:0.0:1788625448.758320:0:21012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788625448.758331:0:21012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788625448.758336:0:21012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625448.758358:0:21012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625448.758391:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998741e09000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788625448.758603:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.759718:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788625448.759730:0:21012:0:(genops.c:885:class_export_put()) final put ffff998741e0e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788625448.759736:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788625448.759746:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788625448.759834:0:21012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427c7800 1 00000020:00000080:0.0:1788625448.759842:0:21012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b4e0 00000020:00000080:0.0:1788625448.759850:0:21012:0:(genops.c:885:class_export_put()) final put ffff99886c326800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788625448.759867:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788625448.759885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99886c326800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788625448.759898:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625448.759906:0:21012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625448.759911:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff998742ed19c0) has no exports 00000100:00080000:3.0:1788625448.778821:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625448.778834:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1788625448.778847:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99887b49b800 using connection 192.168.204.114@tcp/0@lo 00000100:00080000:3.0:1788625448.778905:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788625448.778910:0:3635:0:(import.c:65:import_set_state_nolock()) ffff998742cf4800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788625448.778913:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788625448.778917:0:3635:0:(import.c:65:import_set_state_nolock()) ffff998742cf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625448.778920:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 499 00000100:00080000:3.0:1788625448.778925:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998742cf4800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625448.778961:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743832d80 x1875509206280704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625448.778982:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788625448.779020:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206280704:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788625448.779095:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625448.779141:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625448.779147:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625448.779150:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206280448:0@lo:38:kworker.0 00000100:00100000:3.0:1788625448.779184:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280704 00000100:00100000:3.0:1788625448.779202:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280704 00000100:00100000:3.0:1788625448.779243:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788625448.779251:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280704:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788625448.779270:0:20724:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625448.779311:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280704:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (217us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625448.779318:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788625448.779342:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625448.779345:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625448.779348:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206280704:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788625448.781120:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875509206280192:12345-0@lo:38:kworker.0 Request processed in 55142us (59114us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625448.781133:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788625448.781188:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625448.781194:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625448.781199:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206280192:0@lo:38:kworker.0 00000100:00100000:3.0:1788625448.781268:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743830e00 x1875509206280832/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788625448.781291:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206280576:0@lo:400:kworker.0 00000100:00100000:3.0:1788625448.781316:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206280832:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788625448.781353:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625448.781390:0:20724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206280832 00000100:00100000:3.0:1788625448.781397:0:20724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206280832 00000100:00100000:3.0:1788625448.781429:0:20724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788625448.781436:0:20724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280832:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788625448.781468:0:20724:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788625448.781612:0:20724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875509206280832:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 100us (185us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788625448.781622:0:20724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788625448.781648:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625448.781653:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625448.781656:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206280832:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:3.0:1788625448.940999:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625448.941014:0:21012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788625448.941019:0:21012:0:(genops.c:885:class_export_put()) final put ffff9987427c3800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788625448.941024:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427c3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788625448.941037:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788625448.941235:0:21012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9987427c1000 00000020:01000000:3.0:1788625448.941256:0:21012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788625448.941261:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625448.941266:0:21012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788625448.941270:0:21012:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9988449d0000) has no exports 00000100:00100000:0.0:1788625448.941549:0:20724:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff998845a73c00:20724] 4 exiting: rc = 0 00000100:00100000:2.0:1788625448.941734:0:17241:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff998851da3000:17241] 2 exiting: rc = 0 00000100:00100000:2.0:1788625448.941837:0:18690:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff998742449a00:18690] 3 exiting: rc = 0 00000100:00100000:0.0:1788625448.943033:0:17240:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff998851da3a00:17240] 1 exiting: rc = 0 00000100:00100000:3.0:1788625448.943650:0:17239:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff998851da2e00:17239] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.943787:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943796:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943826:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943834:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943840:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943845:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943850:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943856:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943862:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943868:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943874:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943879:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943885:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943890:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943894:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943900:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943905:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943911:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943917:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943940:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943947:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943952:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943957:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943962:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943968:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943974:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943980:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943986:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943991:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.943997:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944001:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944006:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944013:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944030:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944035:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944040:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944046:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944051:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944057:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944142:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944152:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944157:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944163:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944168:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944174:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944178:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944185:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944190:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944196:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944202:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944207:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944221:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944227:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944232:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944238:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944243:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944249:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944255:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944262:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944267:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.944273:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625448.948577:0:17242:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff998851da3400:17242] 0 exiting: rc = 1 00000100:00100000:1.0:1788625448.948900:0:17243:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff998851da3c00:17243] 1 exiting: rc = 0 00000100:00100000:2.0:1788625448.949023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949033:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949039:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949046:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949051:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949057:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949062:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949067:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949146:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949152:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949158:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949163:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949168:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949173:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949179:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949184:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949189:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949195:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949200:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949206:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949212:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949218:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949223:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949228:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949233:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949255:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949260:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949265:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949271:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949276:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949281:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949286:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949291:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949296:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949301:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949307:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949313:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949319:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949324:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949330:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949336:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949342:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949347:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949353:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949358:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949363:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949376:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949381:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949385:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949391:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949396:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949402:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949407:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949412:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949418:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949423:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949428:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949433:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949438:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949451:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949456:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949461:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.949465:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.950501:0:17978:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff998844f2c800:17978] 2 exiting: rc = 0 00000100:00100000:2.0:1788625448.950878:0:17244:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff998851da2600:17244] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.950946:0:17245:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff998851da3200:17245] 1 exiting: rc = 0 00000100:00100000:1.0:1788625448.951054:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951062:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951079:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951087:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951096:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951103:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951112:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951119:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951127:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951133:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951152:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951172:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951178:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951184:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951192:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951198:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951205:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951211:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951218:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951225:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951233:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951240:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951260:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951268:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951274:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951280:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951287:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951293:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951298:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951306:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951315:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951322:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951328:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951334:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951359:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951367:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951374:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951380:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951386:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951393:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951399:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951406:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951412:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951419:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951426:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951432:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951459:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951466:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951490:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951497:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951504:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951510:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951547:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951555:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951565:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951572:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951580:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951588:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951611:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951618:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951629:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951637:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951645:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.951662:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625448.958083:0:17246:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99887b67f600:17246] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.958212:0:17247:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99887b67f800:17247] 1 exiting: rc = 0 00000100:00100000:1.0:1788625448.958329:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958337:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958343:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958348:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958354:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958359:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958364:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958369:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958374:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958379:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958384:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958389:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958394:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958400:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958405:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958410:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958415:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958439:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958444:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958449:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958453:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958457:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958463:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958468:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958484:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958488:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958494:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958499:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958504:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958509:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958514:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958624:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958629:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958635:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958640:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958646:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958652:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958657:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958662:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958666:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958671:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958676:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958680:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958685:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958690:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958695:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958699:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958705:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958710:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958716:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958721:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958727:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958739:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958745:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958750:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958754:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958759:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958763:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958768:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958775:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958779:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958784:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958789:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.958793:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625448.959190:0:17248:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff998743518400:17248] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.959274:0:17249:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99887b67ec00:17249] 1 exiting: rc = 0 00000100:00100000:1.0:1788625448.959713:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959720:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959726:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959732:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959738:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959744:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959749:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959754:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959760:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959765:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959770:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959776:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959782:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959788:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959794:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959800:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959805:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959810:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959817:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959823:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959829:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959835:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959840:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959858:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959864:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959871:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959877:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959882:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959888:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959894:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959900:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959905:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959910:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959916:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959922:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959927:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959933:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959938:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959944:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959948:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959953:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959959:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959964:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959970:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959975:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959981:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959986:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959991:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.959996:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960003:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960008:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960014:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960018:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960023:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960028:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960033:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960038:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960042:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960053:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960059:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960068:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960073:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960078:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625448.960728:0:17250:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9988580bdc00:17250] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.960813:0:17251:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99887b67cc00:17251] 1 exiting: rc = 0 00000100:00100000:1.0:1788625448.960965:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960972:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960977:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960982:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960987:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960992:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.960997:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961002:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961008:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961013:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961017:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961021:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961026:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961031:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961036:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961041:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961046:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961051:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961056:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961061:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961066:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961071:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961077:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961082:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961088:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961092:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961097:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961102:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961107:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961122:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961129:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961134:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961139:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961144:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961150:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961154:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961159:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961164:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961169:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961174:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961179:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961184:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961189:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961193:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961198:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961203:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961208:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961213:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961218:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961223:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961228:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961232:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961238:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961243:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961247:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961253:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961258:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961263:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961268:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961273:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961278:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961283:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961287:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.961292:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625448.962078:0:17252:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff998851cd0200:17252] 0 exiting: rc = 1 00000100:00100000:2.0:1788625448.962280:0:17254:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff998851cd1800:17254] 2 exiting: rc = 0 00000100:00100000:3.0:1788625448.962569:0:17253:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99887b670200:17253] 1 exiting: rc = 0 00000100:00100000:1.0:1788625448.962860:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962866:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962871:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962877:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962882:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962887:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962892:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962897:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962903:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962908:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962934:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962941:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962947:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962953:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962958:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962963:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962969:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962976:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962982:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962987:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962993:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.962999:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963004:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963010:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963015:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963021:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963026:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963032:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963037:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963043:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963048:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963053:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963058:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963064:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963083:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963100:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963105:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963110:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963116:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963121:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963127:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963133:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963138:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963143:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963148:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963154:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963159:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963163:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963168:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963173:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963179:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963184:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963189:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963195:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963200:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963205:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963210:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963215:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963221:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963227:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963232:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963236:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963241:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788625448.963246:0:21012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788625448.967415:0:21012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625448.967432:0:21012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788625448.967437:0:21012:0:(genops.c:885:class_export_put()) final put ffff998844c25800/MDS_uuid 00000020:00000080:0.0:1788625448.967442:0:21012:0:(genops.c:844:class_export_destroy()) destroying export ffff998844c25800/MDS_uuid for MDS 00000020:01000000:0.0:1788625448.967454:0:21012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788625448.967741:0:21012:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788625449.359107:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625450.386180:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625451.405599:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625452.427786:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625452.986235:0:21214:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788625453.004885:0:21214:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788625453.004945:0:21214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.004962:0:21214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.004986:0:21214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.004993:0:21214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.005016:0:21214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788625453.005022:0:21214:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788625453.005048:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625453.005053:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625453.005060:0:21214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625453.005066:0:21214:0:(import.c:65:import_set_state_nolock()) ffff998742cf4000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625453.005071:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788625453.005073:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625453.005076:0:21214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788625453.010294:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788625453.010303:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788625453.010311:0:21214:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788625453.010318:0:21214:0:(import.c:65:import_set_state_nolock()) ffff998742cf4800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788625453.010325:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788625453.010327:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788625453.010331:0:21214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788625453.012318:0:21214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.012351:0:21214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.012379:0:21214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.012386:0:21214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625453.014180:0:21214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625453.015241:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625453.015253:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015265:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744188c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625453.015270:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015283:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625453.015290:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625453.015297:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625453.015300:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788625453.015303:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788625453.015349:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:2.0:1788625453.015354:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015362:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744188c00/0x2d2e3b3f34a7b653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b65a expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015377:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625453.015381:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015387:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625453.015390:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015407:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625453.015422:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625453.015428:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625453.015430:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788625453.015435:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:2.0:1788625453.015437:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015443:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998743ae1e00/0x2d2e3b3f34a7b629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b630 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015452:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625453.015460:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625453.015462:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625453.015593:0:21214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015604:0:21214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015611:0:21214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015619:0:21214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625453.015656:0:21214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625453.015662:0:21214:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788625453.015666:0:21214:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788625453.015701:0:21214:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788625453.015705:0:21214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788625453.015722:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625453.015729:0:21214:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625453.015737:0:21214:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9987427a3000 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 8589934593 stale:0 00000020:00080000:2.0:1788625453.015743:0:21214:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99887cb1cd40) has no exports 00000020:00080000:2.0:1788625453.015768:0:21214:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99887cb1cd40) has no exports 00010000:00010000:0.0:1788625453.018682:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625453.018699:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625453.018719:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625453.018723:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625453.018754:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625453.018761:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625453.018767:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788625453.018769:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788625453.018772:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788625453.018790:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:0.0:1788625453.018793:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625453.018800:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744189000/0x2d2e3b3f34a7b986 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b994 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625453.018813:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625453.018815:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625453.018817:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625453.019243:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625453.453886:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625453.836010:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 097bbbb0-568c-46a3-88ad-c1c4a94e09ad->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625453.836021:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 097bbbb0-568c-46a3-88ad-c1c4a94e09ad->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625453.836024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625453.836028:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788625453.836033:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625453.836042:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788625453.836050:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788625453.836066:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99887b49b000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625453.836107:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a86680 x1875509206280960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625453.836135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788625453.836139:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788625453.836142:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625453.836145:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788625453.836864:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788625453.836871:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99887b49b800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625453.836892:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a85500 x1875509206281088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625453.836970:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206280960:0@lo:38:kworker.0 00000400:00000100:1.0:1788625453.837037:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206280960 offset 0 length 520: 4 00000100:00100000:1.0:1788625453.837108:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206281088:0@lo:38:kworker.0 00000400:00000100:1.0:1788625453.837127:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875509206281088 offset 0 length 520: 4 00000001:00100000:2.0:1788625453.837804:0:18741:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788625453.837810:0:18741:0:(genops.c:885:class_export_put()) final put ffff9987427a3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625453.837872:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427a3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788625453.837918:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987427a7800 for lustre-OST0000 00000001:00100000:0.0:1788625453.840118:0:19558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788625453.840127:0:19558:0:(genops.c:885:class_export_put()) final put ffff9987426b7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788625453.841948:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff9987426b7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788625453.842996:0:15724:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9987426b3800 for lustre-OST0001 00010000:00010000:3.0:1788625454.482430:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788625455.051690:0:21214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998742d824e0 - data ffff998867a77360/ffff9987434ae400 00000020:01000000:2.0:1788625455.051936:0:21214:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998742f45a20 - data ffff9987421b2438/ffff99884593dc00 00100000:10000000:2.0:1788625455.066337:0:21214:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788625455.084673:0:21214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b63e 00000020:00000080:3.0:1788625455.084688:0:21214:0:(genops.c:885:class_export_put()) final put ffff9987427a1000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788625455.084709:0:21214:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998743b76800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788625455.084713:0:21214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998743b76800 2 00000020:01000004:3.0:1788625455.084716:0:21214:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998743b76800 from lustre-OST0000 00000020:00000080:3.0:1788625455.084743:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625455.084755:0:21214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788625455.084758:0:21214:0:(genops.c:885:class_export_put()) final put ffff9987427a4000/lustre-OST0000_UUID 00000020:00000080:3.0:1788625455.084761:0:21214:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427a4000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788625455.084769:0:21214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788625455.085567:0:21214:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788625455.085574:0:21214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788625455.085581:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625455.085593:0:21214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788625455.085603:0:21214:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9987426b6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788625455.085650:0:21214:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9988442399c0) has exports, disconnecting them 00000020:00080000:3.0:1788625455.085658:0:21214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9987426b6800), last request at 1788625378 00000020:00000080:3.0:1788625455.085663:0:21214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b668 00000020:00080000:3.0:1788625455.085678:0:21214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9987426b6800): rc 0 00000020:00000080:3.0:1788625455.085697:0:21214:0:(genops.c:885:class_export_put()) final put ffff9987426b6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788625455.086736:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427a1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788625455.086758:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff9987426b6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788625455.093373:0:21214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788625455.093389:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788625455.093397:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788625455.093412:0:21214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788625455.093696:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788625455.093707:0:21214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788625455.093715:0:21214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788625455.093726:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788625455.093732:0:21214:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788625455.093744:0:21214:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99887ca90000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788625455.093755:0:21214:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff998742ed4d40) has exports, disconnecting them 00000020:00080000:1.0:1788625455.093762:0:21214:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99887ca90000), last request at 1788625378 00000020:00000080:1.0:1788625455.093767:0:21214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b67d 00000020:00080000:1.0:1788625455.093786:0:21214:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887ca90000): rc 0 00000020:00000080:1.0:1788625455.093793:0:21214:0:(genops.c:885:class_export_put()) final put ffff99887ca90000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788625455.094894:0:15724:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998742cf4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788625455.094907:0:15724:0:(genops.c:885:class_export_put()) final put ffff998742cf6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788625455.094911:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff998742cf6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788625455.094921:0:15724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788625455.095000:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca90000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788625455.095031:0:21214:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788625455.095035:0:21214:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625455.095039:0:21214:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625455.095061:0:21214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625455.095082:0:15724:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998742cf4800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788625455.095229:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625455.095236:0:21214:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788625455.095239:0:21214:0:(genops.c:885:class_export_put()) final put ffff99887ca91800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788625455.095241:0:21214:0:(genops.c:844:class_export_destroy()) destroying export ffff99887ca91800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788625455.095245:0:21214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788625455.095275:0:21214:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998743b76800 1 00000020:00000080:0.0:1788625455.095282:0:21214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b61b 00000020:00000080:0.0:1788625455.095289:0:21214:0:(genops.c:885:class_export_put()) final put ffff998741e0b800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788625455.095297:0:21214:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788625455.095305:0:15724:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788625455.095314:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625455.095318:0:21214:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625455.095321:0:21214:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff998844238000) has no exports 00000020:00000080:0.0:1788625455.195208:0:21214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625455.195225:0:21214:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788625455.195231:0:21214:0:(genops.c:885:class_export_put()) final put ffff998848af9800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788625455.195236:0:21214:0:(genops.c:844:class_export_destroy()) destroying export ffff998848af9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788625455.195246:0:21214:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788625455.195396:0:21214:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998743b70000 00000020:02000400:0.0:1788625455.195804:0:21214:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788625455.501231:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625456.525701:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625457.547655:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625458.573880:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625458.957903:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625448/real 1788625448] req@ffff9988442a7800 x1875509206280064/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625458.957948:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9988442a7800 x1875509206280064/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788625458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625458.957971:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625458.957981:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788625458.957985:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206280064:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788625458.962828:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) 097bbbb0-568c-46a3-88ad-c1c4a94e09ad->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788625458.962839:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788625458.962842:0:15724:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625458.962853:0:15724:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 569 00000100:00080000:1.0:1788625458.962869:0:15724:0:(import.c:630:import_select_connection()) MGC192.168.204.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788625458.962877:0:15724:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff998878127800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625458.962914:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a7800 x1875509206281216/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625458.962939:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788625458.962943:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625458.962946:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788625458.962950:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625458.962981:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206281216:0@lo:250:kworker.0 00000400:00000100:1.0:1788625458.963461:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875509206281216 offset 0 length 520: 4 00000020:01000004:2.0:1788625459.132319:0:21415:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788625459.144009:0:21415:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788625459.144114:0:21415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625459.144605:0:21415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625459.144616:0:21415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625459.144624:0:21415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625459.144687:0:21415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788625459.144695:0:21415:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788625459.144744:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625459.144762:0:21415:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998848a86680 x1875509206280960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625478 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625459.144782:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788625459.144789:0:21415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788625459.144796:0:21415:0:(import.c:65:import_set_state_nolock()) ffff99887b49b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788625459.144803:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625459.144806:0:21415:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998848a86680 x1875509206280960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625478 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625459.144813:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788625459.144816:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788625459.144913:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206280960:0@lo:38:kworker.0 00000100:00080000:0.0:1788625459.145948:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625459.145960:0:21415:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998848a85500 x1875509206281088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625468 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625459.145979:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788625459.145985:0:21415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788625459.145990:0:21415:0:(import.c:65:import_set_state_nolock()) ffff99887b49b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788625459.145995:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625459.146017:0:21415:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff998848a85500 x1875509206281088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788625468 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625459.146024:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788625459.146027:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1788625459.146318:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206281088:0@lo:38:kworker.0 00010000:00010000:0.0:1788625459.147842:0:21415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.147858:0:21415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.147864:0:21415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.147871:0:21415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.147979:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788625459.147987:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.147994:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743ae1c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625459.147998:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148006:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625459.148013:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625459.148018:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625459.148020:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788625459.148023:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788625459.148037:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:3.0:1788625459.148040:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148046:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998743ae1c00/0x2d2e3b3f34a7b6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b6f4 expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148058:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625459.148060:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148081:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998859be8600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625459.148083:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148090:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625459.148096:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625459.148101:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788625459.148103:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788625459.148106:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:3.0:1788625459.148108:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625459.148115:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625459.148116:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625459.148118:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625459.148172:0:21415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625459.148177:0:21415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998859be8600/0x2d2e3b3f34a7b6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b6ca expref: -99 pid: 19557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.148196:0:21415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.148203:0:21415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.148209:0:21415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.148216:0:21415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625459.148295:0:21415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788625459.148301:0:21415:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788625459.148305:0:21415:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788625459.148350:0:21415:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788625459.148356:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788625459.148361:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625459.148368:0:21415:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625459.148373:0:21415:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99885e62cd40) has no exports 00000020:00080000:0.0:1788625459.148397:0:21415:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99885e62cd40) has no exports 00000020:01000000:0.0:1788625459.150580:0:21415:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998742d82180 - data ffff9988679b30d8/ffff998872d32800 00000020:01000000:0.0:1788625459.150759:0:21415:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998742d82a80 - data ffff9987420a2288/ffff9987434ad400 00010000:00010000:1.0:1788625459.151244:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625459.151254:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625459.151265:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998744189a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625459.151271:0:17227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625459.151293:0:17227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625459.151301:0:17227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625459.151331:0:17227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788625459.151334:0:17227:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788625459.151339:0:17227:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788625459.151360:0:17227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:1.0:1788625459.151364:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625459.151371:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744189a00/0x2d2e3b3f34a7b978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b97f expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625459.151389:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625459.151391:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625459.151393:0:17227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625459.151911:0:17228:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788625459.161870:0:21415:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788625459.179162:0:21415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b6d8 00000020:00000080:2.0:1788625459.179199:0:21415:0:(genops.c:885:class_export_put()) final put ffff99874352c000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788625459.179220:0:21415:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9987427a5000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788625459.179224:0:21415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427a5000 2 00000020:01000004:2.0:1788625459.179227:0:21415:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9987427a5000 from lustre-OST0001 00000020:00000080:2.0:1788625459.179262:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625459.179287:0:21415:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788625459.179290:0:21415:0:(genops.c:885:class_export_put()) final put ffff998743529800/lustre-OST0001_UUID 00000020:00000080:2.0:1788625459.179301:0:21415:0:(genops.c:844:class_export_destroy()) destroying export ffff998743529800/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:3.0:1788625459.179313:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874352c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788625459.179313:0:21415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788625459.179433:0:21415:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 097bbbb0-568c-46a3-88ad-c1c4a94e09ad->MGS 00010000:00010000:2.0:1788625459.179452:0:21415:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625459.179465:0:21415:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625459.179471:0:21415:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788625459.179473:0:21415:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788625459.179477:0:21415:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788625459.179494:0:21415:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:2.0:1788625459.179497:0:21415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff998744188e00/0x2d2e3b3f34a7b4e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b4ee expref: -99 pid: 17969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625459.179546:0:21415:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625459.179554:0:21415:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625459.179559:0:21415:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788625459.179561:0:21415:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788625459.179563:0:21415:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788625459.179580:0:21415:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998878127800 00010000:00010000:2.0:1788625459.179583:0:21415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4400/0x2d2e3b3f34a7b3d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2d2e3b3f34a7b3dd expref: -99 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788625459.179604:0:21415:0:(import.c:65:import_set_state_nolock()) ffff998878127800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788625459.179608:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788625459.179611:0:21415:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788625459.179613:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788625459.179619:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788625459.179631:0:21415:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9988442a7800 x1875509206281216/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788625473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788625459.179661:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788625459.179664:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1788625459.179803:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:097bbbb0-568c-46a3-88ad-c1c4a94e09ad:3634:1875509206281216:0@lo:250:kworker.0 10000000:01000000:2.0:1788625459.180033:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788625459.180043:0:21415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b3c1 00000020:00000080:2.0:1788625459.180050:0:21415:0:(genops.c:885:class_export_put()) final put ffff998844c23800/097bbbb0-568c-46a3-88ad-c1c4a94e09ad 00000020:01000000:2.0:1788625459.180065:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.114@tcp (flags='') 00000020:00000080:2.0:1788625459.180151:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625459.180158:0:21415:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788625459.180162:0:21415:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99887cb18000) has no exports 00000020:00000080:0.0:1788625459.180213:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998844c23800/097bbbb0-568c-46a3-88ad-c1c4a94e09ad for MGC192.168.204.114@tcp 10000000:01000000:2.0:1788625459.180585:0:17236:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788625459.181451:0:21415:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.114@tcp: client import never connected 00000100:00080000:3.0:1788625459.181456:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788625459.181459:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788625459.181462:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788625459.181465:0:21415:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788625459.181572:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788625459.181598:0:21415:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.114@tcp (uuid 097bbbb0-568c-46a3-88ad-c1c4a94e09ad) 00000020:01000000:3.0:1788625459.181606:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788625459.181611:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788625459.181615:0:21415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788625459.181623:0:21415:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99887b49c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788625459.181630:0:21415:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff99887da58000) has exports, disconnecting them 00000020:00080000:3.0:1788625459.181634:0:21415:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99887b49c000), last request at 1788625393 00000020:00000080:3.0:1788625459.181640:0:21415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b702 00000020:00080000:3.0:1788625459.181657:0:21415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99887b49c000): rc 0 00000020:00000080:3.0:1788625459.181663:0:21415:0:(genops.c:885:class_export_put()) final put ffff99887b49c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788625459.182041:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998878127800 for MGC192.168.204.114@tcp 00000020:00000080:0.0:1788625459.182052:0:38:0:(genops.c:885:class_export_put()) final put ffff998878125000/097bbbb0-568c-46a3-88ad-c1c4a94e09ad 00000020:00000080:0.0:1788625459.182055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff998878125000/097bbbb0-568c-46a3-88ad-c1c4a94e09ad for MGC192.168.204.114@tcp 00000020:01000000:0.0:1788625459.182062:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.114@tcp (097bbbb0-568c-46a3-88ad-c1c4a94e09ad) 00000020:00000080:0.0:1788625459.182437:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b49c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788625459.207610:0:21415:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788625459.207621:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788625459.207627:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788625459.207635:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625459.207732:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b49b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788625459.208802:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788625459.208814:0:21415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788625459.209037:0:21415:0:(genops.c:885:class_export_put()) final put ffff99885234d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788625459.209044:0:21415:0:(genops.c:844:class_export_destroy()) destroying export ffff99885234d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788625459.209060:0:21415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788625459.209134:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788625459.209151:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788625459.209158:0:21415:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788625459.209167:0:21415:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99874352b000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788625459.209175:0:21415:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9987434b19c0) has exports, disconnecting them 00000020:00080000:2.0:1788625459.209181:0:21415:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99874352b000), last request at 1788625393 00000020:00000080:2.0:1788625459.209186:0:21415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b717 00000020:00080000:2.0:1788625459.209204:0:21415:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99874352b000): rc 0 00000020:00000080:2.0:1788625459.209209:0:21415:0:(genops.c:885:class_export_put()) final put ffff99874352b000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788625459.209255:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99874352b000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788625459.220748:0:21415:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788625459.220763:0:21415:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788625459.220768:0:21415:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788625459.220777:0:21415:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788625459.220816:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99887b49b800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788625459.222051:0:17227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788625459.224507:0:17228:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788625459.225270:0:17223:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99874274ea00:17223] 1 exiting: rc = 0 00000100:00100000:1.0:1788625459.227428:0:17222:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99874274f800:17222] 0 exiting: rc = 1 00000100:00100000:0.0:1788625459.227637:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.228109:0:17224:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff998860864c00:17224] 0 exiting: rc = 1 00000100:00100000:3.0:1788625459.228247:0:17225:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff998860865e00:17225] 1 exiting: rc = 0 00000100:00100000:2.0:1788625459.228427:0:17226:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff998860864800:17226] 2 exiting: rc = 0 00000100:00100000:2.0:1788625459.228485:0:20265:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff998741f8f600:20265] 3 exiting: rc = 0 00000100:00100000:0.0:1788625459.229062:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229072:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229079:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229085:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229092:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229098:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229105:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229111:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229116:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229122:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229127:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229133:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229139:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229147:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229154:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229162:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229172:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229183:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229190:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229243:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229252:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229257:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229263:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229270:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229286:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229292:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229298:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229303:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229309:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229316:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229322:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229329:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229336:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229342:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229348:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229369:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229376:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229382:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229388:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229394:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229400:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229409:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229415:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229420:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229426:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229431:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229437:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229443:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229449:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229455:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229461:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229467:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229473:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229478:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229484:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229490:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229496:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229502:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229508:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229513:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229942:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229952:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229959:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.229966:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788625459.231159:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625459.231172:0:21415:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788625459.231255:0:21415:0:(genops.c:885:class_export_put()) final put ffff99887b499800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788625459.231262:0:21415:0:(genops.c:844:class_export_destroy()) destroying export ffff99887b499800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788625459.231268:0:21415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788625459.231347:0:21415:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9987427a5000 1 00000020:00000080:0.0:1788625459.231355:0:21415:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2d2e3b3f34a7b6bc 00000020:00000080:0.0:1788625459.231362:0:21415:0:(genops.c:885:class_export_put()) final put ffff9988582ee000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788625459.231445:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788625459.231450:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625459.231456:0:21415:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788625459.231461:0:21415:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff99887cb199c0) has no exports 00000020:00000080:3.0:1788625459.235495:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9988582ee000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788625459.270148:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625459.270166:0:21415:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788625459.270174:0:21415:0:(genops.c:885:class_export_put()) final put ffff9987427a5800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788625459.270179:0:21415:0:(genops.c:844:class_export_destroy()) destroying export ffff9987427a5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788625459.270195:0:21415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788625459.275264:0:21415:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9987427a2000 00000020:01000000:0.0:1788625459.275322:0:21415:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788625459.275472:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788625459.275480:0:21415:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788625459.275486:0:21415:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff99887da5cd40) has no exports 00000020:00000080:0.0:1788625459.275595:0:21415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788625459.275608:0:21415:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788625459.275614:0:21415:0:(genops.c:885:class_export_put()) final put ffff998741e0d800/OSS_uuid 00000020:00000080:0.0:1788625459.275619:0:21415:0:(genops.c:844:class_export_destroy()) destroying export ffff998741e0d800/OSS_uuid for OSS 00000020:01000000:0.0:1788625459.275625:0:21415:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788625459.276090:0:18746:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9988442f2800:18746] 1 exiting: rc = 0 00000100:00100000:2.0:1788625459.276324:0:18745:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99887d909600:18745] 0 exiting: rc = 1 00000100:00100000:3.0:1788625459.276501:0:18747:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9988442f3200:18747] 2 exiting: rc = 0 00000100:00100000:2.0:1788625459.276982:0:19761:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9988442b9000:19761] 4 exiting: rc = 0 00000100:00100000:2.0:1788625459.277069:0:19755:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9988441bd000:19755] 3 exiting: rc = 0 00000100:00100000:0.0:1788625459.277187:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277196:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277202:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277208:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277214:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277220:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277225:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277232:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277238:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277244:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277268:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277284:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277291:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277297:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277303:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277308:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277314:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277319:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277326:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277332:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277429:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277435:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277442:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277448:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277454:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277459:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277465:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277471:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277477:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277485:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277492:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277498:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277548:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277555:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277561:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277567:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277573:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277579:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277585:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277591:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277598:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277606:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277623:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277633:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277639:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277652:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277658:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277664:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277671:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277676:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277684:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277690:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277980:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277990:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.277996:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278002:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278007:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278012:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278018:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278024:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278030:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278036:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278041:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.278060:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1788625459.279664:0:17235:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788625459.280280:0:18749:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff998741d36800:18749] 1 exiting: rc = 0 00000100:00100000:3.0:1788625459.280439:0:18748:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9988442f3800:18748] 0 exiting: rc = 1 00000100:00100000:1.0:1788625459.280667:0:20432:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99886cbc7200:20432] 2 exiting: rc = 0 00000100:00100000:0.0:1788625459.280943:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280952:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280958:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280964:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280970:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280976:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280982:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280988:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.280994:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281001:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281007:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281013:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281019:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281028:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281034:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281039:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281064:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281070:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281076:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281083:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281090:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281096:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281101:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281107:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281112:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281119:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281125:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281131:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281137:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281143:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281149:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281155:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281161:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281166:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281171:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281178:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281184:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281189:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281194:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281200:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281207:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281212:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281217:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281223:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281230:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281236:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281242:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281247:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281253:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281258:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281263:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281287:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281292:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281297:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281302:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281308:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281314:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281319:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281325:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281331:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281421:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281428:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281434:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.281440:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.283190:0:18752:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9988441b3200:18752] 2 exiting: rc = 0 00000100:00100000:3.0:1788625459.283632:0:18750:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99887b730000:18750] 0 exiting: rc = 1 00000100:00100000:2.0:1788625459.284043:0:18751:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99887b731000:18751] 1 exiting: rc = 0 00000100:00100000:0.0:1788625459.284158:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284166:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284172:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284179:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284185:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284203:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284212:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284218:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284225:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284233:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284239:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284248:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284255:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284262:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284270:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284287:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284293:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284300:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284306:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284313:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.284319:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285094:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285121:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285129:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285135:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285141:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285148:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285154:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285160:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285166:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285172:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285178:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285183:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285188:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285195:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285201:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285207:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285213:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285219:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285226:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285231:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285238:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285244:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285251:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285257:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285265:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285283:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285290:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285298:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285314:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285321:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285327:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285343:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285350:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285365:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285373:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285391:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285405:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285412:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285419:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285425:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285432:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285438:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788625459.285450:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296025:0:18754:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9988441b3c00:18754] 1 exiting: rc = 0 00000100:00100000:2.0:1788625459.296228:0:18753:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9988441b2400:18753] 0 exiting: rc = 1 00000100:00100000:3.0:1788625459.296353:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296362:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296368:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296374:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296379:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296384:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296391:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296398:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296403:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296409:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296415:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296420:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296444:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296450:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296456:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296461:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296467:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296472:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296477:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296482:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296487:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296492:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296497:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296502:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296508:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296556:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296564:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296570:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296575:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296581:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296586:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296591:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296597:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296601:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296606:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296612:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296617:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296622:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296627:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296633:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296639:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296644:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296683:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296690:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296706:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296713:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296718:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296731:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296738:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296742:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296747:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296752:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296757:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296764:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296769:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296774:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296779:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296784:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296789:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296794:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296799:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296803:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296808:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.296813:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788625459.298166:0:18755:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff998844384c00:18755] 0 exiting: rc = 1 00000100:00100000:0.0:1788625459.298494:0:18756:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9987438fb200:18756] 1 exiting: rc = 0 00000100:00100000:3.0:1788625459.298674:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298687:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298782:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298793:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298799:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298805:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298812:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298847:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298934:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298942:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298949:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298959:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298965:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298972:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298979:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298987:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298994:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.298999:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299027:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299054:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299062:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299069:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299076:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299084:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299091:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299097:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299104:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299111:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299118:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299125:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299132:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299154:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299164:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299172:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299178:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299184:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299191:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299198:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299204:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299213:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299219:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299226:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299232:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299254:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299262:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299269:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299289:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299296:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299303:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299310:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299317:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299324:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299330:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299429:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299438:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299461:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299469:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299476:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299483:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299490:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299497:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299504:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299511:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788625459.299683:0:21415:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788625459.317144:0:21415:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788625480.867137:0:22179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788625490.926970:0:22778:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625490.926976:0:22778:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788625490.926978:0:22778:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788625490.927094:0:22778:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998872de2800 00000020:01000004:2.0:1788625490.927111:0:22778:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788625490.927118:0:22778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788625490.927131:0:22778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99884423b380) 00000020:00000080:2.0:1788625490.927144:0:22778:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788625490.983471:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788625490.984190:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788625490.985495:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788625490.989022:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.989711:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.989972:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.990498:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.991016:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.991484:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.991849:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.992331:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.992742:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.993039:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.993715:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.994034:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.994720:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.995017:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.995303:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.995751:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.996320:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.996799:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.997062:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.997685:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.997972:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.998301:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788625490.998689:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.999010:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788625490.999451:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788625491.000789:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788625491.001277:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788625491.001685:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788625491.001981:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788625491.002435:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788625491.002798:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788625491.003239:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788625491.007153:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.007799:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.008050:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.009302:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.009787:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.010044:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.010288:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.010685:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.011010:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.011250:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.011625:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788625491.011960:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.012618:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.013122:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.013693:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.014301:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.014710:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788625491.015057:0:22778:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788625491.018129:0:22778:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788625491.018378:0:22778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788625491.018387:0:22778:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788625491.018400:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bcc7 00000020:01000004:1.0:1788625491.018407:0:22778:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788625491.018411:0:22778:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788625491.018416:0:22778:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998872de2800 from MGS 00000020:01000004:1.0:1788625491.018420:0:22778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788625491.018429:0:22778:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9987434b3380) 00000020:00000080:1.0:1788625491.018438:0:22778:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788625491.018501:0:22778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998872de2800 from MGS, refs=2 00080000:01000000:1.0:1788625491.018506:0:22778:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625491.018511:0:22778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bcd5 00000100:00100000:1.0:1788625491.018671:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788625491.018806:0:22778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788625491.018811:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788625491.020997:0:22778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788625491.021009:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788625491.022884:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625491.023094:0:22778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788625491.023101:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788625491.024137:0:22778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788625491.024147:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788625491.024476:0:22778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788625491.024483:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788625491.025387:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.025392:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.025394:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.025985:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.025988:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.025989:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625491.026492:0:22778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788625491.030885:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788625491.051709:0:22778:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788625491.056712:0:22790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788625491.056858:0:22778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788625491.056939:0:22778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788625491.058258:0:22778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788625491.058579:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625491.058785:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788625491.058793:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788625491.059625:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788625491.059633:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788625491.061982:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788625491.061994:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788625491.063254:0:22795:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788625491.063384:0:22778:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788625491.063406:0:22778:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.114@tcp' 00000020:01000004:2.0:1788625491.063408:0:22778:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788625491.063441:0:22778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.114@tcp (typ=mgc) 00000020:00000080:2.0:1788625491.063457:0:22778:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.114@tcp (ffff998844238000) 00000020:00000080:2.0:1788625491.063473:0:22778:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788625491.063586:0:22778:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998872de2000@MGC192.168.204.114@tcp: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625491.063913:0:22778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.114@tcp-0 is initialized 00000040:01000000:2.0:1788625491.063920:0:22778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788625491.074418:0:22796:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788625491.074597:0:22778:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.114@tcp (uuid 808ac1e0-6c01-40fe-b8c2-33bc603cb30f) 00000020:00000080:3.0:1788625491.074627:0:22778:0:(genops.c:1385:class_connect()) connect: client 808ac1e0-6c01-40fe-b8c2-33bc603cb30f, cookie 0x2d2e3b3f34a7bce3 00000100:00080000:3.0:1788625491.074642:0:22778:0:(import.c:545:import_select_connection()) MGC192.168.204.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625491.074649:0:22778:0:(import.c:665:import_select_connection()) MGC192.168.204.114@tcp: import ffff998872de2000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625491.074703:0:22778:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743830e00 x1875509206281344/t0(0) o250->MGC192.168.204.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625491.074738:0:22778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 808ac1e0-6c01-40fe-b8c2-33bc603cb30f->MGS 00000020:01000004:3.0:1788625491.074762:0:22778:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788625491.074776:0:22778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788625491.074791:0:22778:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff998742ed19c0) 00000020:00000080:3.0:1788625491.074805:0:22778:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788625491.080870:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3634:1875509206281344:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788625491.081030:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625491.081151:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281344 00000100:00100000:1.0:1788625491.081160:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281344 00000100:00100000:1.0:1788625491.081206:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625491.081224:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875509206281344:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788625491.081255:0:22792:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 808ac1e0-6c01-40fe-b8c2-33bc603cb30f@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:1.0:1788625491.081280:0:22792:0:(genops.c:1385:class_connect()) connect: client 808ac1e0-6c01-40fe-b8c2-33bc603cb30f, cookie 0x2d2e3b3f34a7bcf1 00000100:00080000:1.0:1788625491.081421:0:22792:0:(import.c:65:import_set_state_nolock()) ffff99886cbf5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625491.081472:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:3634:x1875509206281344:12345-0@lo:250:mount.lustre.0 Request processed in 247us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625491.081479:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625491.087536:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788625491.087554:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.114@tcp: connect to target with instance 0 00000100:00080000:2.0:1788625491.087563:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788625491.087569:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788625491.087573:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998872de2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788625491.087576:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788625491.087590:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788625491.087598:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3634:1875509206281344:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788625491.097643:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625491.098346:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788625491.098354:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788625491.100150:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788625491.100163:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788625491.100513:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788625491.100548:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788625491.101415:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625491.101689:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788625491.101695:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788625491.102506:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788625491.102706:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788625491.141819:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625491.142048:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788625491.142057:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788625491.143380:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788625491.143393:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788625491.144182:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625491.144403:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788625491.144412:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788625491.147160:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788625491.147179:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788625491.150050:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625491.150270:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788625491.150276:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788625491.151871:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788625491.151890:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788625491.152630:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788625491.152883:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788625491.152889:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788625491.156815:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788625491.156828:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788625491.190403:0:22778:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625491.190671:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788625491.190678:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788625491.194537:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788625491.194565:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788625491.196104:0:22778:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788625491.196119:0:22778:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788625491.201722:0:22778:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788625491.201752:0:22778:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788625491.201758:0:22778:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788625491.201860:0:22778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788625491.201897:0:22778:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788625491.201902:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788625491.201903:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788625491.201905:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625491.201906:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625491.201907:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625491.201908:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625491.201909:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625491.201911:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788625491.201913:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625491.201914:0:22778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625491.201916:0:22778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788625491.201918:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625491.201919:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788625491.201920:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625491.201921:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625491.201922:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625491.201923:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625491.201924:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625491.201925:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788625491.201926:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625491.201927:0:22778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788625491.201957:0:22778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788625491.201978:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625491.202055:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.202105:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c8c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.202626:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281472 00000100:00100000:3.0:1788625491.202634:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281472 00000100:00100000:3.0:1788625491.202691:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625491.202700:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:22778:x1875509206281472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625491.202762:0:22794:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788625491.202765:0:22794:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788625491.202768:0:22794:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788625491.203335:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788625491.203842:0:22794:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788625491.206385:0:22816:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788625491.206392:0:22816:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788625491.206395:0:22816:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788625491.206398:0:22816:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788625491.206804:0:22816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788625491.215636:0:22794:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788625491.215661:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788625491.218003:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:22778:x1875509206281472:12345-0@lo:253:mount.lustre.0 Request processed in 15294us (15938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625491.218019:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625491.218212:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625491.218231:0:22778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788625491.218235:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625491.218237:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625491.218238:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625491.218250:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625491.218252:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625491.218253:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625491.218254:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625491.218256:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625491.218258:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625491.218260:0:22778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788625491.218279:0:22778:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998872de2800 from lustre-MDT0000 10000000:01000000:0.0:1788625491.218311:0:22778:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788625491.218314:0:22778:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788625491.218318:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff998844238000 10000000:01000000:0.0:1788625491.218322:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625491.218330:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998844238000 from 1 10000000:01000000:0.0:1788625491.218332:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788625491.218369:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.218381:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.218391:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.218411:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625491.218450:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.218495:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625491.218597:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281600 00000100:00100000:1.0:1788625491.218605:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281600 00000100:00100000:1.0:1788625491.218661:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625491.218671:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:22778:x1875509206281600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625491.218683:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625491.218700:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743541a00/0x2d2e3b3f34a7bcff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bcf8 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.218736:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743541a00/0x2d2e3b3f34a7bcff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bcf8 expref: 6 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.218749:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743541a00/0x2d2e3b3f34a7bcff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bcf8 expref: 6 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.218771:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743541a00, rc 0) 00000100:00100000:1.0:1788625491.218810:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:22778:x1875509206281600:12345-0@lo:101:mount.lustre.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625491.218816:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625491.218958:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.218971:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.218980:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.219050:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.219092:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.219110:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.219232:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281728 00000100:00100000:3.0:1788625491.219237:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281728 00000100:00100000:3.0:1788625491.219268:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625491.219276:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:22778:x1875509206281728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625491.219362:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:22778:x1875509206281728:12345-0@lo:501:mount.lustre.0 Request processed in 86us (269us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625491.219368:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625491.219470:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281728:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788625491.219495:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788625491.219514:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.219612:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625491.219620:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998872de2800 10000000:01000000:0.0:1788625491.219625:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788625491.219628:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998872de2800 10000000:01000000:0.0:1788625491.219631:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788625491.219633:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998872de2800 from 1 10000000:01000000:0.0:1788625491.219636:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788625491.219665:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.219673:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.219682:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.219696:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625491.219859:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.219922:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.220249:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281856 00000100:00100000:3.0:1788625491.220255:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281856 00000100:00100000:3.0:1788625491.220286:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625491.220293:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:22778:x1875509206281856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625491.220302:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625491.220318:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682200/0x2d2e3b3f34a7bd0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bd06 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.220338:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682200/0x2d2e3b3f34a7bd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bd06 expref: 7 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.220348:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682200/0x2d2e3b3f34a7bd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bd06 expref: 7 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.220356:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682200, rc 0) 00000100:00100000:3.0:1788625491.220443:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+7:22778:x1875509206281856:12345-0@lo:101:mount.lustre.0 Request processed in 151us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625491.220449:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625491.220706:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.220791:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd0d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.220802:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bd0d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625491.220816:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788625491.220868:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd0d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.220877:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21400/0x2d2e3b3f34a7bd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd0d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625491.220884:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788625491.220888:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625491.220893:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998872de2800 10000000:01000000:0.0:1788625491.220896:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788625491.220899:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788625491.220901:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788625491.220922:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.220930:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.220937:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.220962:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625491.220992:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.221024:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.221089:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206281984 00000100:00100000:2.0:1788625491.221094:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206281984 00000100:00100000:2.0:1788625491.221127:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625491.221134:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+7:22778:x1875509206281984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625491.221142:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625491.221154:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4400/0x2d2e3b3f34a7bd1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bd14 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.221170:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4400/0x2d2e3b3f34a7bd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bd14 expref: 8 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.221179:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4400/0x2d2e3b3f34a7bd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bd14 expref: 8 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.221185:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4400, rc 0) 00000100:00100000:2.0:1788625491.221220:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+8:22778:x1875509206281984:12345-0@lo:101:mount.lustre.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.221226:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625491.221295:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206281984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.221306:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd1b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.221314:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bd1b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.221369:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206282112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.221394:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.221417:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.221723:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206282112 00000100:00100000:2.0:1788625491.221728:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206282112 00000100:00100000:2.0:1788625491.221755:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625491.221762:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+8:22778:x1875509206282112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625491.221881:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22778:x1875509206282112:12345-0@lo:501:mount.lustre.0 Request processed in 120us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.221889:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788625491.222005:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206282112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.222035:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206282240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625491.222093:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.222120:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887caca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.222165:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206282240 00000100:00100000:2.0:1788625491.222169:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206282240 00000100:00100000:2.0:1788625491.222200:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625491.222206:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22778:x1875509206282240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625491.223456:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22778:x1875509206282240:12345-0@lo:503:mount.lustre.0 Request processed in 1243us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.223469:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788625491.223632:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206282240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625491.224186:0:22817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22817:1875509206282368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625491.224234:0:22817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.224271:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff998846425000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.224367:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206282368 00000100:00100000:3.0:1788625491.224373:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206282368 00000100:00100000:3.0:1788625491.224420:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625491.224428:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22817:x1875509206282368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625491.225222:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22817:x1875509206282368:12345-0@lo:502:llog_process_th.0 Request processed in 793us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625491.225229:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625491.225326:0:22817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22817:1875509206282368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788625491.225357:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625491.225373:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.225376:0:22817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788625491.225381:0:22817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788625491.225383:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625491.225398:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99885e628000) 00000020:00000080:0.0:1788625491.225415:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788625491.225420:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788625491.225493:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788625491.225501:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd29 00000020:00000080:0.0:1788625491.225884:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788625491.225889:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625491.225893:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.225895:0:22817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788625491.225898:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625491.225901:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.225903:0:22817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788625491.225906:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625491.225915:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99885e62b380) 00000020:00000080:0.0:1788625491.225925:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788625491.225929:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788625491.225931:0:22817:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788625491.225934:0:22817:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788625491.225940:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625491.225985:0:22817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998872de2800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788625491.225997:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99885e6299c0) 00000020:00000080:0.0:1788625491.226004:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788625491.226074:0:22817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788625491.226082:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7bd3e 00000020:00000080:0.0:1788625491.226171:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788625491.226177:0:22817:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788625491.226182:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2d2e3b3f34a7bd45 00080000:01000000:0.0:1788625491.226187:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788625491.226192:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd4c 00010000:00010000:1.0:1788625491.311448:0:22817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788625491.312284:0:22817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1788625491.312636:0:22817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788625491.313253:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9987434b4d40) 00000020:00000080:1.0:1788625491.313273:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788625491.320563:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788625491.320579:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd5a 00000020:00000080:1.0:1788625491.333055:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788625491.339964:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2d2e3b3f34a7bd61 00000020:00000080:3.0:1788625491.341284:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788625491.341301:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.341309:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.341312:0:22817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788625491.341316:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625491.341319:0:22817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788625491.341321:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625491.341323:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625491.341324:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625491.341326:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.341328:0:22817:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625491.341330:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.341336:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.341337:0:22817:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788625491.341343:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788625491.341399:0:22817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788625491.341434:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.341437:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.341439:0:22817:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788625491.341442:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.341445:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.341446:0:22817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788625491.341449:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625491.341465:0:22817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:3.0:1788625491.341503:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625491.341548:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff998742ed3380) 00000020:00000080:3.0:1788625491.341567:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788625491.341574:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625491.341632:0:22817:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788625491.341638:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788625491.341718:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd6f 00010000:00080000:3.0:1788625491.341765:0:22817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b47e000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625491.344875:0:22817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788625491.352170:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788625491.352191:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788625491.352252:0:22817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788625491.352280:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7bd76 00000100:00080000:1.0:1788625491.352295:0:22817:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625491.352302:0:22817:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99887b47e000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625491.353082:0:22817:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a4e00 x1875509206282496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625491.354386:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625491.354485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.354924:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206282496 00000100:00100000:3.0:1788625491.354936:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206282496 00000100:00100000:3.0:1788625491.354994:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625491.355002:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206282496:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788625491.355024:0:22804:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788625491.355297:0:22817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788625491.355421:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625491.355428:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.355430:0:22817:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788625491.355434:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788625491.355437:0:22817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788625491.355439:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788625491.355440:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788625491.355441:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788625491.355444:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.355445:0:22817:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788625491.355448:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788625491.355454:0:22817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788625491.355457:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625491.355459:0:22817:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788625491.355463:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788625491.355467:0:22817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:0.0:1788625491.355495:0:22817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788625491.355498:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625491.355545:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99885e62cd40) 00000020:00000080:0.0:1788625491.355567:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788625491.355573:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788625491.355685:0:22817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788625491.355692:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788625491.355700:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd84 00010000:00080000:0.0:1788625491.355732:0:22817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9988582ec800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625491.355977:0:22817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788625491.359907:0:22817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788625491.360105:0:22817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788625491.371853:0:22817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625491.372185:0:22817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788625491.385305:0:22817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788625491.391702:0:22823:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788625491.391723:0:22823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788625491.395140:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625491.395159:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625491.395209:0:22817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788625491.395234:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7bd8b 00000100:00080000:2.0:1788625491.395247:0:22817:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625491.395253:0:22817:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9988582ec800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625491.395295:0:22817:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844359880 x1875509206282624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625491.395430:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788625491.395490:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206282624 offset 0 length 520: 4 00000100:00080000:2.0:1788625491.395727:0:22817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788625491.395800:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625491.395805:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.395807:0:22817:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788625491.395810:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625491.395813:0:22817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788625491.395815:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625491.395816:0:22817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625491.395818:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625491.395820:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.395822:0:22817:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625491.395824:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625491.395829:0:22817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788625491.395833:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.395840:0:22817:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788625491.395844:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788625491.395848:0:22817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:2.0:1788625491.395869:0:22817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788625491.395872:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625491.395885:0:22817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9988442399c0) 00000020:00000080:2.0:1788625491.395898:0:22817:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788625491.395903:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788625491.395992:0:22817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788625491.395999:0:22817:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788625491.396006:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2d2e3b3f34a7bd99 00010000:00080000:2.0:1788625491.396047:0:22817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9987438d1800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625491.396272:0:22817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788625491.397144:0:22817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788625491.397163:0:22817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788625491.397837:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206282496:12345-0@lo:38:llog_process_th.0 Request processed in 42832us (43350us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625491.397852:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788625491.399319:0:22817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625491.400454:0:22817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788625491.400672:0:22817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00080000:3.0:1788625491.401164:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625491.401174:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625491.401179:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282496:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788625491.401258:0:22825:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788625491.401265:0:22825:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788625491.401901:0:22817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788625491.401916:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788625491.401954:0:22817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788625491.401974:0:22817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7bda0 00000100:00080000:2.0:1788625491.401985:0:22817:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625491.401994:0:22817:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9987438d1800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625491.402037:0:22817:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99884435a680 x1875509206282752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625491.402133:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282752:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788625491.402204:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206282752 offset 0 length 520: 4 00000100:00080000:2.0:1788625491.402418:0:22817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788625491.402499:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625491.402504:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.402505:0:22817:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788625491.402509:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625491.402512:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.402513:0:22817:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625491.402546:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625491.402548:0:22817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625491.402551:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625491.402553:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.402555:0:22817:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788625491.402557:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625491.402559:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.402560:0:22817:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625491.402564:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788625491.402599:0:22817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22817:1875509206282880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.402665:0:22817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.402699:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206282880 00000100:00100000:2.0:1788625491.402707:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206282880 00000100:00100000:2.0:1788625491.402754:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625491.402764:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22817:x1875509206282880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.402883:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22817:x1875509206282880:12345-0@lo:502:llog_process_th.0 Request processed in 120us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.402891:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788625491.402944:0:22817:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.402964:0:22817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22817:1875509206282880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788625491.402988:0:22817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625491.402993:0:22817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625491.402994:0:22817:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625491.402998:0:22817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788625491.403056:0:22778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788625491.403075:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788625491.403089:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd1b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.403444:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da20c00/0x2d2e3b3f34a7bd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bd1b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625491.403453:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998872de2800 from 1 10000000:01000000:2.0:1788625491.403456:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788625491.403489:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.403498:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.403511:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625491.403594:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625491.403636:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.403800:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885235fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.404244:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283008 00000100:00100000:3.0:1788625491.404253:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283008 00000100:00100000:3.0:1788625491.404340:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625491.404351:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+9:22778:x1875509206283008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625491.404364:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625491.404381:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bda7 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.404404:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 10 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.404432:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 10 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.404441:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682400, rc 0) 00000100:00100000:3.0:1788625491.404504:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+10:22778:x1875509206283008:12345-0@lo:101:mount.lustre.0 Request processed in 155us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625491.404510:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625491.404643:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.404670:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.404680:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.405557:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283136:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788625491.405623:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.405855:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.405924:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283136 00000100:00100000:2.0:1788625491.405931:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283136 00000100:00100000:2.0:1788625491.405964:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625491.405971:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+10:22778:x1875509206283136:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788625491.405993:0:22794:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788625491.406000:0:22794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788625491.406077:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+10:22778:x1875509206283136:12345-0@lo:256:mount.lustre.0 Request processed in 105us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.406199:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625491.406279:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283136:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788625491.406858:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625491.406878:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.406890:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625491.406898:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998872de2800 from 1 10000000:01000000:0.0:1788625491.406901:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625491.406933:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.407003:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.407014:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.407035:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625491.407081:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.407602:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283264 00000100:00100000:2.0:1788625491.407609:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283264 00000100:00100000:2.0:1788625491.407657:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788625491.407666:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+10:22778:x1875509206283264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625491.407679:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625491.407696:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bdb5 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.407721:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 11 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.407731:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 11 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.407741:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4600, rc 0) 00000100:00100000:0.0:1788625491.407816:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.408269:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283264:12345-0@lo:101:mount.lustre.0 Request processed in 603us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.408277:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625491.408347:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.408368:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.408378:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.408463:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.408495:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.408778:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283392 00000100:00100000:3.0:1788625491.408784:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283392 00000100:00100000:2.0:1788625491.408828:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.409082:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625491.409091:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625491.409349:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283392:12345-0@lo:501:mount.lustre.0 Request processed in 258us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.409357:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625491.409436:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625491.409476:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625491.409568:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.409810:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff998841254600 going to sleep for 11 seconds 00000100:00100000:1.0:1788625491.409916:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283520 00000100:00100000:1.0:1788625491.409923:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283520 00000100:00100000:1.0:1788625491.409948:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625491.409955:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625491.410057:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283520:12345-0@lo:503:mount.lustre.0 Request processed in 101us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625491.410085:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625491.410514:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625491.411037:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22827:1875509206283648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625491.411154:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.411199:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff998841254e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625491.411252:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283648 00000100:00100000:1.0:1788625491.411258:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283648 00000100:00100000:1.0:1788625491.411288:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625491.411296:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22827:x1875509206283648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.412107:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22827:x1875509206283648:12345-0@lo:502:llog_process_th.0 Request processed in 808us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.412130:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625491.412310:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22827:1875509206283648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625491.412343:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.412354:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.412357:0:22827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625491.412365:0:22827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998872de2800 00000020:00000080:3.0:1788625491.412368:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625491.412376:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.412379:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.412385:0:22827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625491.412388:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.412391:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.412393:0:22827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625491.412396:0:22827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998872de2800 00000020:00000080:3.0:1788625491.412398:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625491.412501:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.412505:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.412507:0:22827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625491.412509:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.412512:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.412514:0:22827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788625491.412676:0:22827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998872de2800 00000020:00000080:2.0:1788625491.412680:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788625491.412877:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.416282:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.416292:0:22827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625491.416304:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625491.416310:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.416312:0:22827:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625491.416318:0:22827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998872de2800 00000020:00000080:3.0:1788625491.416320:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788625491.416423:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22827:1875509206283776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625491.416502:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.416570:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842ca8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625491.416632:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283776 00000100:00100000:1.0:1788625491.416640:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283776 00000100:00100000:1.0:1788625491.416700:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788625491.416715:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22827:x1875509206283776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788625491.416831:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22827:x1875509206283776:12345-0@lo:502:llog_process_th.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625491.416838:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625491.416993:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22827:1875509206283776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788625491.417023:0:22827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625491.417028:0:22827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625491.417029:0:22827:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625491.417034:0:22827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788625491.417261:0:22778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788625491.417284:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625491.417304:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.417314:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625491.417365:0:22778:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788625491.417368:0:22778:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998872de2800 10000000:01000000:1.0:1788625491.417371:0:22778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998872de2800 10000000:01000000:1.0:1788625491.417375:0:22778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625491.417381:0:22778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998872de2800 from 1 10000000:01000000:1.0:1788625491.417384:0:22778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788625491.417414:0:22778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.417428:0:22778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625491.417439:0:22778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625491.417456:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625491.417492:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625491.430401:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437bc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625491.432890:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206283904 00000100:00100000:0.0:1788625491.432907:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206283904 00000100:00100000:0.0:1788625491.432973:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625491.432984:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22778:x1875509206283904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.433001:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625491.433023:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20e00/0x2d2e3b3f34a7bdca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bdc3 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.433053:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20e00/0x2d2e3b3f34a7bdca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bdc3 expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.433072:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20e00/0x2d2e3b3f34a7bdca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bdc3 expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.433082:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20e00, rc 0) 00000100:00100000:0.0:1788625491.433163:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206283904:12345-0@lo:101:mount.lustre.0 Request processed in 181us (15669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.433170:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788625491.433600:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206283904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625491.433620:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdca expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.433631:0:22778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bdca expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.433812:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.433855:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.439876:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.440016:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284032 00000100:00100000:3.0:1788625491.440026:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284032 00000100:00100000:3.0:1788625491.442961:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625491.443050:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625491.443456:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284032:12345-0@lo:501:mount.lustre.0 Request processed in 416us (9599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625491.443465:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788625491.445385:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625491.445473:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625491.445548:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.445581:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625491.445598:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284160 00000100:00100000:0.0:1788625491.445605:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284160 00000100:00100000:0.0:1788625491.445655:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625491.445663:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625491.446683:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284160:12345-0@lo:503:mount.lustre.0 Request processed in 1014us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.446694:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788625491.446768:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625491.448610:0:22833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788625491.448708:0:22833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.448805:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284288 00000100:00100000:0.0:1788625491.448814:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284288 00000100:00100000:0.0:1788625491.448864:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788625491.448875:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625491.449482:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284288:12345-0@lo:502:llog_process_th.0 Request processed in 606us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.449491:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625491.453874:0:22833:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842ca8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625491.453914:0:22833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284288:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788625491.454061:0:22833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788625491.454077:0:22833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff998742ed4d40) 00000020:00000080:3.0:1788625491.454150:0:22833:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788625491.454320:0:22833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998872de2800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788625491.454325:0:22833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998872de2800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788625491.454327:0:22833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998872de2800 4 00010000:00080000:3.0:1788625491.454421:0:22833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b64a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625491.459196:0:22833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788625491.459568:0:22833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788625491.459621:0:22833:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625491.459640:0:22833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2d2e3b3f34a7bdd8 00000100:00080000:3.0:1788625491.462836:0:22833:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625491.462847:0:22833:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99887b64a800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625491.463122:0:22833:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844358000 x1875509206284416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625491.463144:0:22833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788625491.463828:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206284416:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625491.463916:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.464294:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284416 00000100:00100000:2.0:1788625491.464302:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284416 00000100:00100000:2.0:1788625491.464341:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625491.464349:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206284416:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625491.464407:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206284416:12345-0@lo:38:llog_process_th.0 Request processed in 58us (491us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788625491.464414:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625491.464624:0:22833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.464676:0:22833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.464700:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284544 00000100:00100000:2.0:1788625491.464703:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284544 00000100:00100000:2.0:1788625491.464809:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625491.464816:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.464922:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284544:12345-0@lo:502:llog_process_th.0 Request processed in 106us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625491.464929:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625491.464966:0:22833:0:(client.c:2716:ptlrpc_set_wait()) set ffff998846425300 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.464984:0:22833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.465020:0:22833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788625491.465052:0:22833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625491.465063:0:22833:0:(client.c:2716:ptlrpc_set_wait()) set ffff998846425300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625491.465219:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284672 00000100:00100000:0.0:1788625491.465224:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284672 00000100:00100000:0.0:1788625491.465250:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625491.465256:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788625491.465326:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22833:x1875509206284672:12345-0@lo:502:llog_process_th.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.465333:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625491.465377:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625491.465385:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625491.465389:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788625491.465392:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206284416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625491.465824:0:22833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22833:1875509206284672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788625491.465846:0:22833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788625491.466026:0:22778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788625491.466046:0:22778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788625491.466093:0:22778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdca expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.466105:0:22778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743540800/0x2d2e3b3f34a7bdc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bdca expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788625491.466158:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788625491.466162:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625491.466163:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625491.466164:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625491.466165:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625491.466166:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625491.466168:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625491.466169:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625491.466171:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625491.466172:0:22778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625491.466176:0:22778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788625491.466179:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625491.466180:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788625491.466181:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625491.466183:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625491.466184:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625491.466185:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625491.466186:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625491.466188:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788625491.466189:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625491.466190:0:22778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788625491.466208:0:22778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788625491.466223:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625491.466267:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.466305:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625491.466725:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284800 00000100:00100000:2.0:1788625491.466811:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284800 00000100:00100000:2.0:1788625491.466858:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788625491.466867:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625491.466894:0:22792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625491.466911:0:22792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788625491.471065:0:22792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788625491.471082:0:22792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788625491.471322:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22778:x1875509206284800:12345-0@lo:253:mount.lustre.0 Request processed in 4451us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625491.471334:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788625491.471416:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22778:1875509206284800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788625491.471429:0:22778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788625491.471433:0:22778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788625491.471434:0:22778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788625491.471435:0:22778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788625491.471437:0:22778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788625491.471438:0:22778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788625491.471440:0:22778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788625491.471441:0:22778:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788625491.471443:0:22778:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788625491.471445:0:22778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788625491.471446:0:22778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788625491.471462:0:22778:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788625491.471800:0:22815:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788625491.471805:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788625491.471828:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.471857:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 11 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.471866:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.471909:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 11 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.471929:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 11 pid: 22792 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625491.471945:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206284928:0@lo:104: 00000100:00100000:3.0:1788625491.471989:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625491.472026:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625491.472659:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206284928 00000100:00100000:0.0:1788625491.472670:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206284928 00000100:00100000:0.0:1788625491.474095:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625491.474115:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206284928:12345-0@lo:104: 00010000:00010000:0.0:1788625491.474135:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.474230:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625491.474237:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206284928:12345-0@lo:104: Request processed in 131us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.474243:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625491.474336:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206284928:0@lo:104: 00010000:00010000:3.0:1788625491.474361:0:22815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474378:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625491.474389:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474397:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625491.474401:0:22788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474410:0:22788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625491.474432:0:22788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625491.474438:0:22788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625491.474479:0:22788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474485:0:22788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625491.474539:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474548:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4200/0x2d2e3b3f34a7bda7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdae expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625491.474566:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.474568:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625491.474575:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625491.474675:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206285056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625491.474793:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625491.475793:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285056 00000100:00100000:0.0:1788625491.475802:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285056 00010000:00010000:0.0:1788625491.475833:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 12 pid: 22792 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625491.475868:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625491.475877:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:3638:x1875509206285056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625491.475890:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625491.475896:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 12 pid: 22792 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.475908:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 12 pid: 22792 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.475927:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682400/0x2d2e3b3f34a7bdae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bda7 expref: 12 pid: 22792 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.475944:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.475954:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625491.476093:0:22784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004287958s 00010000:00010000:0.0:1788625491.476098:0:22784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476105:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476112:0:22784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476120:0:22784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476126:0:22784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625491.476130:0:22784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476139:0:22784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.476241:0:22815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625491.476249:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476280:0:22784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476288:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b682a00/0x2d2e3b3f34a7bddf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625491.476302:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625491.476452:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:3638:x1875509206285056:12345-0@lo:103:ldlm_bl.0 Request processed in 574us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625491.476459:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625491.476896:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206285056:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788625491.483712:0:22778:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788625491.484201:0:22778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788625491.484319:0:22838:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788625491.484323:0:22838:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788625491.484814:0:22839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788625491.485085:0:22778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788625491.485469:0:22840:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff998743832300 x1875509206285184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625491.485483:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788625491.485769:0:22839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788625491.487124:0:22778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788625491.487180:0:22778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788625491.489627:0:22778:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788625491.489680:0:22778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788625491.489884:0:22778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625491.490352:0:22839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788625491.490496:0:22839:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788625491.491847:0:22778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788625491.493153:0:22778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788625491.493236:0:22778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788625491.495386:0:22778:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788625491.497292:0:22778:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788625491.506285:0:22778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788625491.509201:0:22778:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788625491.509250:0:22778:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6ab019ab988 00100000:10000000:0.0:1788625491.509258:0:22778:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788625491.510039:0:22778:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788625491.510055:0:22778:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788625491.510076:0:22778:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788625491.510094:0:22778:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788625491.512170:0:22778:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625491.512849:0:22778:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625492.048121:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625492.491604:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788625492.497404:0:22832:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625492.497418:0:22832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625492.508354:0:22832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788625492.508369:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788625492.811570:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625492.811577:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998872de2800 from 11 10000000:01000000:3.0:1788625492.811582:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625492.811637:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625492.811650:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625492.811675:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625492.812070:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206285312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625492.812142:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625492.812199:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625492.812269:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285312 00000100:00100000:0.0:1788625492.812277:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285312 00000100:00100000:0.0:1788625492.812338:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625492.812348:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+11:22796:x1875509206285312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625492.812361:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625492.812376:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bde6 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625492.812401:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 12 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625492.812412:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 12 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625492.812422:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20600, rc 0) 00000100:00100000:0.0:1788625492.812466:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22796:x1875509206285312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625492.812480:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788625492.812549:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206285312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625492.812564:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625492.812573:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625492.812633:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206285440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788625492.812674:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625492.812770:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625492.812913:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285440 00000100:00100000:0.0:1788625492.812918:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285440 00000100:00100000:0.0:1788625492.812942:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625492.812949:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22796:x1875509206285440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625492.812963:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625492.812978:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625492.812981:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788625492.813049:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:22796:x1875509206285440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625492.813056:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788625492.813085:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206285440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625492.813120:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625492.813127:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625492.813144:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625493.068706:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625493.515622:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788625493.515963:0:22832:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788625493.515968:0:22832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625493.516103:0:22832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788625493.516146:0:22832:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788625493.516283:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788625494.092183:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625494.541164:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625495.119885:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625495.565723:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625496.139702:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788625496.244325:0:23083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788625496.588156:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000100:00080000:1.0:1788625496.843755:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788625496.843763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788625496.843768:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625496.843777:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788625496.843783:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788625496.843788:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788625496.843789:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99887b47e000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625496.843801:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206285568:0@lo:400:kworker.0 00000100:00100000:1.0:1788625496.843823:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a7100 x1875509206285696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625496.843840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625496.843844:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625496.843846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625496.843861:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625496.843864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788625496.843867:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788625496.843869:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b64a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625496.843874:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99887b64a800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625496.843878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625496.843886:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a4e00 x1875509206285824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625496.843908:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206285696:0@lo:38:kworker.0 00000100:00100000:1.0:1788625496.843949:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625496.843949:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285568 00000100:00100000:0.0:1788625496.843957:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285568 00000100:00100000:1.0:1788625496.843969:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206285824:0@lo:38:kworker.0 00000100:00100000:1.0:1788625496.843997:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625496.844009:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788625496.844017:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:3636:x1875509206285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625496.844031:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285696 00000100:00100000:1.0:1788625496.844036:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285696 00000100:00100000:1.0:1788625496.844054:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625496.844060:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206285696:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788625496.844067:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:3636:x1875509206285568:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625496.844074:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00020000:1.0:1788625496.844092:0:22805:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788625496.844128:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206285568:0@lo:400:kworker.0 00000100:00100000:1.0:1788625496.844320:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206285696:12345-0@lo:38:kworker.0 Request processed in 258us (369us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788625496.844328:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788625496.844363:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625496.844367:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788625496.844370:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206285696:0@lo:38:kworker.0 00000100:00100000:2.0:1788625496.845655:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285824 00000100:00100000:2.0:1788625496.845670:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285824 00000100:00100000:2.0:1788625496.845714:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625496.845721:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206285824:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788625496.845753:0:22801:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:2.0:1788625496.845794:0:22801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2d2e3b3f34a7bdf4 00000004:00100000:2.0:1788625496.845811:0:22801:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788625496.845986:0:22801:0:(import.c:65:import_set_state_nolock()) ffff99887b6f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625496.846069:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875509206285824:12345-0@lo:38:kworker.0 Request processed in 348us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625496.846088:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788625496.846457:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9988442a4e00 x1875509206285824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788625496.846475:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788625496.846483:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788625496.846488:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625496.846491:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b64a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625496.846497:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875509206285824:0@lo:38:kworker.0 00010000:00010000:3.0:1788625497.163898:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788625497.289841:0:23135:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625497.290064:0:23135:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625497.614329:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625498.192403:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625498.333925:0:23185:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625498.334155:0:23185:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625498.636848:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625499.212219:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625499.660145:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788625500.242708:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625500.684144:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788625501.260321:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625501.708740:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000100:00100000:3.0:1788625501.964590:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625491/real 1788625491] req@ffff99884435a680 x1875509206282752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625501.964622:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99884435a680 x1875509206282752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625501.964632:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625491/real 1788625491] req@ffff998844359880 x1875509206282624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625501 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625501.964644:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998844359880 x1875509206282624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625501 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625501.964664:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625501.964675:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625501.964679:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282752:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788625501.964684:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625501.964698:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625501.964701:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206282624:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788625501.965659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788625501.965665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788625501.965669:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625501.965677:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 617 00000100:00080000:0.0:1788625501.965683:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788625501.965689:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99887b47e000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625501.965711:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a85880 x1875509206286080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625501.965734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625501.965737:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788625501.965739:0:37:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625501.965742:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788625501.965745:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788625501.965748:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9988582ec800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625501.965762:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a84a80 x1875509206286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625501.965769:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625501.965772:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625501.965774:0:37:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625501.965776:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788625501.965779:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788625501.965782:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9987438d1800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625501.965791:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a87b80 x1875509206286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625501.965838:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625501.965852:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206285952:0@lo:400:kworker.0 00000100:00100000:0.0:1788625501.965924:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625501.965980:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788625501.966009:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625501.966049:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285952 00000100:00100000:0.0:1788625501.966056:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285952 00000100:00100000:0.0:1788625501.966104:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625501.966120:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:3635:x1875509206285952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625501.967343:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:3635:x1875509206285952:12345-0@lo:400:kworker.0 Request processed in 1218us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625501.967355:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788625501.967423:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286464 00000100:00100000:0.0:1788625501.967431:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286464 00000100:00100000:0.0:1788625501.967484:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625501.967493:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625501.967559:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206286464:12345-0@lo:400:kworker.0 Request processed in 67us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625501.967565:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788625501.967611:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998848a85f80 x1875509206286464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625501.967627:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788625501.967658:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286080:0@lo:38:kworker.0 00000100:00100000:0.0:1788625501.967696:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625501.967722:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286208:0@lo:8:kworker.0 00000400:00000100:0.0:1788625501.967740:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206286208 offset 0 length 520: 4 00000100:00100000:0.0:1788625501.967752:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286336:0@lo:8:kworker.0 00000400:00000100:0.0:1788625501.967767:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206286336 offset 0 length 520: 4 00000100:00100000:0.0:1788625501.967794:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286080 00000100:00100000:0.0:1788625501.967798:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286080 00000100:00100000:0.0:1788625501.967819:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625501.967824:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206286080:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788625501.967841:0:22805:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788625501.967885:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206286080:12345-0@lo:38:kworker.0 Request processed in 59us (189us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788625501.967892:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788625501.967920:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625501.967925:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788625501.967928:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286080:0@lo:38:kworker.0 00000100:00100000:3.0:1788625501.968026:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206285952:0@lo:400:kworker.0 00010000:00010000:1.0:1788625502.284415:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625502.731737:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625503.308800:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625503.755650:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000040:00080000:3.0:1788625503.759272:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788625504.337714:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625504.780683:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625505.357740:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625505.803694:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000020:01000004:2.0:1788625506.053937:0:23530:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625506.053942:0:23530:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788625506.053944:0:23530:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788625506.054063:0:23530:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998874b51800 00000020:01000004:2.0:1788625506.054081:0:23530:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788625506.054093:0:23530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788625506.054109:0:23530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99884423cd40) 00000020:00000080:2.0:1788625506.054127:0:23530:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788625506.124017:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.124391:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788625506.126608:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.126939:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.127205:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.127490:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.127969:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.129370:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.130320:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.130949:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.131916:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.132301:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.132797:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.133406:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.133779:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.134255:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.134495:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.134827:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.135296:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.135614:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.135898:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.136144:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.136507:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.136743:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.136951:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.137251:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788625506.137474:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.137728:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788625506.140352:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788625506.141942:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788625506.142379:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788625506.142667:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788625506.142934:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788625506.143219:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788625506.148829:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.149089:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788625506.149553:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.149738:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.149934:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788625506.150240:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.150462:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.150829:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788625506.151023:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788625506.151304:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788625506.151541:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788625506.151767:0:23530:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788625506.154751:0:23530:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788625506.155012:0:23530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788625506.155028:0:23530:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788625506.155057:0:23530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be02 00000020:01000004:3.0:1788625506.155067:0:23530:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788625506.155091:0:23530:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788625506.155095:0:23530:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788625506.155103:0:23530:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788625506.155145:0:23530:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788625506.155150:0:23530:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788625506.163311:0:23530:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788625506.163379:0:23530:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788625506.163384:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788625506.163386:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625506.163387:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625506.163389:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625506.163390:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625506.163392:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625506.163393:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625506.163395:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625506.163396:0:23530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625506.163399:0:23530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788625506.163401:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625506.163403:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625506.163404:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625506.163405:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625506.163406:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625506.163407:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625506.163408:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625506.163409:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625506.163410:0:23530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625506.163501:0:23530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788625506.163807:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625506.163939:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.164004:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788625506.164074:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286592 00000100:00100000:2.0:1788625506.164082:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286592 00000100:00100000:2.0:1788625506.164216:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625506.164230:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:23530:x1875509206286592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625506.164274:0:22793:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788625506.164279:0:22793:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788625506.164290:0:22793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788625506.164999:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:23530:x1875509206286592:12345-0@lo:253:mount.lustre.0 Request processed in 769us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625506.165009:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788625506.165099:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625506.165115:0:23530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788625506.165118:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625506.165119:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788625506.165120:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625506.165121:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625506.165122:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625506.165122:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625506.165124:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788625506.165199:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625506.165201:0:23530:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788625506.165227:0:23530:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998874b51800 from lustre-MDT0001 10000000:01000000:0.0:1788625506.165255:0:23530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788625506.165259:0:23530:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788625506.165267:0:23530:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998844238000 local copy 00010000:00010000:0.0:1788625506.165279:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625506.165396:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625506.165502:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.165706:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625506.165748:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286720 00000100:00100000:2.0:1788625506.165766:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286720 00000100:00100000:2.0:1788625506.165837:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625506.165847:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:23530:x1875509206286720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625506.165936:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:23530:x1875509206286720:12345-0@lo:501:mount.lustre.0 Request processed in 91us (434us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788625506.165943:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788625506.166016:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286720:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788625506.166031:0:23530:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788625506.166052:0:23530:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788625506.166060:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.166070:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625506.166100:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998874b51800 10000000:01000000:1.0:1788625506.166106:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788625506.166112:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff998844238000 10000000:01000000:1.0:1788625506.166114:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788625506.166118:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff998844238000 from 1 10000000:01000000:1.0:1788625506.166138:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788625506.166168:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.166177:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.166186:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625506.166200:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625506.166231:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.166412:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.166648:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286848 00000100:00100000:0.0:1788625506.166654:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286848 00000100:00100000:0.0:1788625506.166682:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788625506.166690:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+12:23530:x1875509206286848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625506.166701:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625506.166719:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20000/0x2d2e3b3f34a7be10 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7be09 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.166757:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20000/0x2d2e3b3f34a7be10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be09 expref: 13 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.166767:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20000/0x2d2e3b3f34a7be10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be09 expref: 13 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.166776:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20000, rc 0) 00000100:00100000:0.0:1788625506.166818:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+13:23530:x1875509206286848:12345-0@lo:101:mount.lustre.0 Request processed in 129us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.166825:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788625506.166909:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625506.166923:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be10 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.166933:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7be10 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625506.166951:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788625506.166966:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be10 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.166974:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743541c00/0x2d2e3b3f34a7be09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be10 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625506.166983:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998874b51800 10000000:01000000:1.0:1788625506.166987:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788625506.166996:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998874b51800 from 1 10000000:01000000:1.0:1788625506.166998:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788625506.167016:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.167024:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.167031:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625506.167045:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625506.167073:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.167095:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625506.167180:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206286976 00000100:00100000:2.0:1788625506.167185:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206286976 00000100:00100000:1.0:1788625506.167348:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788625506.167355:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+13:23530:x1875509206286976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625506.167374:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625506.167384:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743541000/0x2d2e3b3f34a7be1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7be17 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.167399:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743541000/0x2d2e3b3f34a7be1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be17 expref: 14 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.167407:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743541000/0x2d2e3b3f34a7be1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be17 expref: 14 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.167414:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743541000, rc 0) 00000100:00100000:1.0:1788625506.167462:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+14:23530:x1875509206286976:12345-0@lo:101:mount.lustre.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.167478:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625506.167616:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206286976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625506.167628:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be1e expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.167635:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7be1e expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625506.167647:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788625506.167652:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be1e expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.167659:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743540200/0x2d2e3b3f34a7be17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be1e expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625506.167665:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788625506.167670:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625506.167676:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998874b51800 10000000:01000000:2.0:1788625506.167680:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788625506.167683:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788625506.167685:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788625506.167701:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.167714:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.167721:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625506.167735:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625506.167764:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.167799:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.167878:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287104 00000100:00100000:0.0:1788625506.167883:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287104 00000100:00100000:0.0:1788625506.167906:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788625506.167912:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+14:23530:x1875509206287104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625506.167920:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625506.167929:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20200/0x2d2e3b3f34a7be2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7be25 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.167942:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20200/0x2d2e3b3f34a7be2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be25 expref: 15 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.167951:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20200/0x2d2e3b3f34a7be2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7be25 expref: 15 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.167957:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20200, rc 0) 00000100:00100000:0.0:1788625506.167984:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287104:12345-0@lo:101:mount.lustre.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.167990:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625506.168310:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625506.168324:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be2c expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.168332:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7be2c expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625506.169848:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788625506.171235:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625506.176880:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788625506.176962:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788625506.176980:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788625506.176994:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788625506.177009:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788625506.177021:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788625506.177032:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788625506.177044:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788625506.177056:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788625506.177068:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788625506.177094:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788625506.177109:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788625506.177124:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788625506.177231:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788625506.177244:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788625506.177257:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788625506.177271:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788625506.177285:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788625506.177297:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788625506.177311:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788625506.177325:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788625506.177339:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788625506.177352:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788625506.177382:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788625506.177398:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788625506.177412:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788625506.177509:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788625506.177796:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788625506.177818:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788625506.177833:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788625506.177847:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788625506.177860:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788625506.177874:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788625506.177890:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788625506.177903:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788625506.177916:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788625506.177929:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788625506.177942:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788625506.177956:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788625506.177972:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788625506.177985:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788625506.178000:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788625506.178016:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788625506.178028:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788625506.178056:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788625506.178062:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788625506.178260:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625506.178336:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.178445:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788625506.179626:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287232 00000100:00100000:2.0:1788625506.179643:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287232 00000100:00100000:2.0:1788625506.179776:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625506.179788:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625506.180032:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287232:12345-0@lo:501:mount.lustre.0 Request processed in 245us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625506.180042:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788625506.180158:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625506.180218:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625506.180283:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.181152:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.181287:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287360 00000100:00100000:1.0:1788625506.181294:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287360 00000100:00100000:1.0:1788625506.181339:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788625506.181348:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625506.182388:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287360:12345-0@lo:503:mount.lustre.0 Request processed in 1036us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.182399:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788625506.182555:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625506.183102:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625506.183338:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.183439:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.183499:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.183607:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287488 00000100:00100000:1.0:1788625506.183615:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287488 00000100:00100000:1.0:1788625506.183656:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625506.183664:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625506.184617:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287488:12345-0@lo:502:mount.lustre.0 Request processed in 949us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.184627:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625506.184858:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625506.185268:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788625506.185307:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788625506.185328:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788625506.185342:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788625506.185355:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788625506.185382:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788625506.185395:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788625506.185406:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788625506.185419:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788625506.185554:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788625506.185573:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788625506.185586:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788625506.185600:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788625506.185614:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788625506.185625:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788625506.185637:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788625506.185650:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788625506.185663:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788625506.185679:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788625506.185692:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788625506.185704:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788625506.185716:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788625506.185728:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788625506.185741:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788625506.185753:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788625506.185765:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788625506.185779:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788625506.185794:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788625506.185820:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788625506.185835:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788625506.185847:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788625506.185860:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788625506.185874:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788625506.185888:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788625506.185902:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788625506.185916:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788625506.185928:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788625506.185939:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788625506.185953:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788625506.185966:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788625506.185979:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788625506.185991:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788625506.186004:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788625506.186018:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788625506.186066:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.186508:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.186665:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.186823:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287616 00000100:00100000:1.0:1788625506.186833:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287616 00000100:00100000:1.0:1788625506.186929:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788625506.186938:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625506.187077:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206287616:12345-0@lo:502:mount.lustre.0 Request processed in 139us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.187085:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788625506.187174:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206287616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625506.187245:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788625506.187258:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788625506.188205:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625506.188221:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625506.188224:0:23534:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788625506.188233:0:23534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788625506.188236:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625506.188256:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9988449d0000) 00000020:00000080:0.0:1788625506.188283:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788625506.188290:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788625506.190644:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788625506.190680:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be3a 00000020:00000080:0.0:1788625506.190946:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788625506.190957:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625506.190962:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625506.190964:0:23534:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788625506.190968:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625506.190976:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625506.190978:0:23534:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788625506.190981:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788625506.190995:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9988449d3380) 00000020:00000080:0.0:1788625506.191014:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788625506.191018:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788625506.191020:0:23534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788625506.191023:0:23534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788625506.191029:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788625506.191087:0:23534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998874b51800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788625506.191098:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9988449d4d40) 00000020:00000080:0.0:1788625506.191108:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788625506.192317:0:23534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788625506.192328:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7be4f 00000020:00000080:0.0:1788625506.192806:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788625506.192816:0:23534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788625506.192821:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2d2e3b3f34a7be56 00080000:01000000:0.0:1788625506.192829:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788625506.192832:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be5d 00010000:00010000:1.0:1788625506.267242:0:23534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788625506.268154:0:23534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788625506.268682:0:23534:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788625506.273096:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788625506.273133:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788625506.273142:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625506.273145:0:23534:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788625506.273149:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788625506.273157:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625506.273158:0:23534:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788625506.273162:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788625506.273168:0:23534:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:00000080:1.0:1788625506.273202:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625506.273233:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9987434b0000) 00000020:00000080:1.0:1788625506.273258:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788625506.273264:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788625506.273934:0:23534:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788625506.273945:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788625506.273954:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be6b 00010000:00080000:1.0:1788625506.273998:0:23534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887b49d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625506.279676:0:23534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788625506.281970:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788625506.281987:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788625506.282026:0:23534:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788625506.282049:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7be72 00000100:00080000:1.0:1788625506.282062:0:23534:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788625506.282069:0:23534:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99887b49d800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625506.282118:0:23534:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a7100 x1875509206287744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625506.282152:0:23534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788625506.282189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788625506.282194:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788625506.282196:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788625506.282200:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:1.0:1788625506.282213:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788625506.282223:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99887b47e000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:1.0:1788625506.282239:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9988442a5880 x1875509206287872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788625506.282249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625506.282252:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625506.282256:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625506.282259:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625506.282311:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788625506.282434:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.282476:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206287744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625506.282972:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.283019:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206287872:0@lo:38:kworker.0 00000100:00100000:3.0:1788625506.283042:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.284795:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287744 00000100:00100000:3.0:1788625506.284812:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287744 00000100:00100000:3.0:1788625506.284847:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206287872 00000100:00100000:3.0:1788625506.284849:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206287872 00000100:00100000:3.0:1788625506.284866:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788625506.284876:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206287744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625506.284906:0:22805:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:3.0:1788625506.284949:0:22805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7be79 00000004:00100000:3.0:1788625506.284967:0:22805:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788625506.284973:0:22805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788625506.286406:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288000 00000100:00100000:3.0:1788625506.286423:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288000 00000100:00100000:3.0:1788625506.286480:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625506.286490:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206288000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625506.286606:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206288000:12345-0@lo:400:kworker.0 Request processed in 118us (4205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.286614:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1788625506.286722:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.286732:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286735:0:23534:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788625506.286740:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625506.286742:0:23534:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788625506.286744:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.286745:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.286747:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625506.286749:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286750:0:23534:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625506.286753:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.286758:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286760:0:23534:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788625506.286764:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788625506.286829:0:23534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788625506.286849:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.286852:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286854:0:23534:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788625506.286857:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625506.286858:0:23534:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788625506.286860:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.286861:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.286863:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625506.286866:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286867:0:23534:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625506.286870:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788625506.286873:0:23534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788625506.286876:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.286878:0:23534:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788625506.286881:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625506.286885:0:23534:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000020:01000000:3.0:1788625506.286910:0:23534:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788625506.286913:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788625506.286929:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff998742ed0000) 00000020:00000080:3.0:1788625506.286950:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788625506.286957:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625506.287024:0:23534:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788625506.287031:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788625506.287038:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be87 00010000:00080000:3.0:1788625506.287075:0:23534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887ca92800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625506.287334:0:23534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00010000:00080000:1.0:1788625506.287454:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9988442a6d80 x1875509206288000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625506.287471:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206288000:0@lo:400:kworker.0 00000040:01000000:1.0:1788625506.295743:0:23534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788625506.296027:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788625506.304270:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625506.308732:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788625506.309042:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1788625506.309408:0:22805:0:(import.c:65:import_set_state_nolock()) ffff998743839800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625506.309588:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206287744:12345-0@lo:38:llog_process_th.0 Request processed in 24711us (26613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625506.309600:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625506.309630:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625506.309636:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206287872:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788625506.309692:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875509206287872:12345-0@lo:38:kworker.0 Request processed in 55us (26648us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788625506.309698:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625506.312374:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625506.312400:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788625506.312415:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788625506.312425:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788625506.312430:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b49d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788625506.312461:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206287744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788625506.312501:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788625506.312507:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625506.312511:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788625506.312534:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206287872:0@lo:38:kworker.0 00000100:00100000:3.0:1788625506.312593:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206288128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625506.312678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.312805:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288128 00000100:00100000:0.0:1788625506.312814:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288128 00000100:00100000:0.0:1788625506.312878:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625506.312888:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206288128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625506.312930:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788625506.312988:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206288128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.312995:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625506.313034:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206288128:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788625506.314660:0:23539:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788625506.314672:0:23539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788625506.319004:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788625506.319104:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788625506.319164:0:23534:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788625506.319196:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7be8e 00000100:00080000:3.0:1788625506.319211:0:23534:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625506.319218:0:23534:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625506.319268:0:23534:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743833100 x1875509206288256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788625506.319373:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206288256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788625506.319445:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206288256 offset 0 length 520: 4 00000100:00080000:3.0:1788625506.319558:0:23534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788625506.319613:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.319618:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.319619:0:23534:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788625506.319622:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788625506.319626:0:23534:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788625506.319627:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.319629:0:23534:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788625506.319631:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788625506.319634:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.319647:0:23534:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788625506.319651:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788625506.319657:0:23534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788625506.319661:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.319663:0:23534:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788625506.319667:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788625506.319670:0:23534:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.114@tcp to nid 0x20000c0a8cc72 (192.168.204.114@tcp) 00000100:00080000:1.0:1788625506.319691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:3.0:1788625506.319695:0:23534:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000100:00080000:1.0:1788625506.319698:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788625506.319699:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1788625506.319704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625506.319709:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1788625506.319715:0:23534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff998873948000) 00000020:00000080:3.0:1788625506.319732:0:23534:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788625506.319738:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788625506.319812:0:23534:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788625506.319821:0:23534:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788625506.319827:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2d2e3b3f34a7be9c 00010000:00080000:3.0:1788625506.319874:0:23534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887ca90800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625506.320317:0:23534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788625506.320467:0:23534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788625506.320488:0:23534:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788625506.323624:0:23534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625506.323851:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788625506.323996:0:23534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788625506.326511:0:23541:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788625506.326612:0:23541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788625506.327397:0:23534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788625506.327412:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788625506.327639:0:23534:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788625506.327668:0:23534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7bea3 00000100:00080000:3.0:1788625506.327682:0:23534:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625506.327734:0:23534:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887ca90800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625506.327820:0:23534:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743833b80 x1875509206288384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625506.327849:0:23534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788625506.328121:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.328151:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.328154:0:23534:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788625506.328157:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.328162:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.328163:0:23534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788625506.328166:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788625506.328168:0:23534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788625506.328170:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.328173:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.328174:0:23534:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788625506.328176:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.328197:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.328199:0:23534:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788625506.328203:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788625506.328244:0:23534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.328259:0:23534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.328260:0:23534:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788625506.328263:0:23534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1788625506.328343:0:23530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788625506.328390:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788625506.328406:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be2c expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328427:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4e00/0x2d2e3b3f34a7be25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7be2c expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625506.328437:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998874b51800 from 1 10000000:01000000:3.0:1788625506.328440:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625506.328467:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328475:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328494:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.328513:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625506.328612:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.328655:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842ca8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788625506.328678:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288512 00000100:00100000:3.0:1788625506.328685:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288512 00000100:00100000:3.0:1788625506.328729:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625506.328738:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+15:23530:x1875509206288512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625506.328751:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625506.328765:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7beaa expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328788:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 16 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328799:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 16 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328808:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683400, rc 0) 00000100:00100000:3.0:1788625506.328841:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:23530:x1875509206288512:12345-0@lo:101:mount.lustre.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.328860:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625506.328914:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625506.328928:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.328943:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.329469:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288640:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788625506.329511:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.329570:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842ca8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.330166:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206288384:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788625506.330231:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206288384 offset 0 length 520: 4 00000100:00080000:1.0:1788625506.333677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625506.333690:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625506.333721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625506.333725:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625506.333765:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288640 00000100:00100000:1.0:1788625506.333778:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288640 00000100:00100000:1.0:1788625506.333855:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788625506.333869:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:23530:x1875509206288640:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788625506.333904:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788625506.333923:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788625506.333927:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788625506.334224:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:23530:x1875509206288640:12345-0@lo:256:mount.lustre.0 Request processed in 357us (4711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.334234:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788625506.334389:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288640:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788625506.336837:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625506.336868:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.336885:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625506.336894:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998874b51800 from 1 10000000:01000000:2.0:1788625506.336898:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625506.336945:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.336955:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.336967:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625506.336998:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625506.337245:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.337330:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625506.337708:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288768 00000100:00100000:3.0:1788625506.337718:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288768 00000100:00100000:3.0:1788625506.337834:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788625506.337845:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:23530:x1875509206288768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625506.337862:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625506.337880:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7beb8 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.337910:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.337921:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.337931:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683600, rc 0) 00000100:00100000:3.0:1788625506.337997:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206288768:12345-0@lo:101:mount.lustre.0 Request processed in 154us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.338003:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788625506.338103:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625506.338121:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.338153:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625506.339757:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788625506.341806:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625506.343246:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788625506.343302:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788625506.343318:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788625506.343334:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788625506.343348:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788625506.343373:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788625506.343388:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788625506.343402:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788625506.343415:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788625506.343736:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788625506.343753:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788625506.343782:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788625506.343789:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788625506.343928:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625506.344009:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.344907:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.354271:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206288896 00000100:00100000:1.0:1788625506.354290:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206288896 00000100:00100000:1.0:1788625506.354501:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788625506.354531:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206288896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625506.354757:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206288896:12345-0@lo:501:mount.lustre.0 Request processed in 244us (10746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.354766:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788625506.356223:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206288896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625506.356293:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625506.356381:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.359263:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788625506.361192:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289024 00000100:00100000:3.0:1788625506.361212:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289024 00000100:00100000:3.0:1788625506.361289:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625506.361323:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625506.364715:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625506.365160:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289024:12345-0@lo:503:mount.lustre.0 Request processed in 3837us (8775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.365174:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:0.0:1788625506.366817:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625506.367009:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.368338:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.369264:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625506.372656:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289152 00000100:00100000:3.0:1788625506.372675:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289152 00000100:00100000:3.0:1788625506.372795:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625506.372807:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625506.373132:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625506.373410:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788625506.373463:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788625506.373480:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788625506.373495:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788625506.373508:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788625506.373550:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788625506.373566:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788625506.373582:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788625506.373598:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788625506.373613:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788625506.373628:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788625506.373670:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625506.373729:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.373791:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289152:12345-0@lo:502:mount.lustre.0 Request processed in 213us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.373800:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625506.374311:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842577d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625506.379024:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289280 00000100:00100000:3.0:1788625506.379046:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289280 00000100:00100000:3.0:1788625506.379106:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625506.379118:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625506.379348:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289280:12345-0@lo:502:mount.lustre.0 Request processed in 231us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.379375:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788625506.379663:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625506.379795:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788625506.379816:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00010000:00010000:3.0:1788625506.381131:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788625506.381316:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.381328:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381331:0:23543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625506.381341:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998874b51800 00000020:00000080:3.0:1788625506.381345:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625506.381367:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.381371:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381373:0:23543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625506.381376:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.381386:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381388:0:23543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625506.381392:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998874b51800 00000020:00000080:3.0:1788625506.381394:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625506.381500:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.381504:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381506:0:23543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625506.381508:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.381511:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381512:0:23543:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625506.381544:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998874b51800 00000020:00000080:3.0:1788625506.381546:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625506.381567:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.381570:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381571:0:23543:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625506.381573:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625506.381576:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381577:0:23543:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625506.381581:0:23543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998874b51800 00000020:00000080:3.0:1788625506.381583:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625506.381605:0:23543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625506.381609:0:23543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625506.381611:0:23543:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625506.381614:0:23543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788625506.384576:0:23530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788625506.384634:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625506.384658:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.384672:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625506.384763:0:23530:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788625506.384767:0:23530:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998874b51800 10000000:01000000:1.0:1788625506.384770:0:23530:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998874b51800 10000000:01000000:1.0:1788625506.384774:0:23530:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788625506.384780:0:23530:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998874b51800 from 1 10000000:01000000:1.0:1788625506.384783:0:23530:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788625506.384832:0:23530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.384841:0:23530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.384854:0:23530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625506.384882:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788625506.384962:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.385011:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289408 00000100:00100000:1.0:1788625506.385019:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289408 00000100:00100000:1.0:1788625506.385070:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625506.385081:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:23530:x1875509206289408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625506.385098:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625506.385113:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743541400/0x2d2e3b3f34a7becd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bec6 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.385138:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743541400/0x2d2e3b3f34a7becd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bec6 expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.385164:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743541400/0x2d2e3b3f34a7becd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bec6 expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.385173:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743541400, rc 0) 00000100:00100000:1.0:1788625506.385212:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289408:12345-0@lo:101:mount.lustre.0 Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.385219:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625506.385271:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.385299:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625506.385315:0:23530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7becd expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625506.385326:0:23530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7becd expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625506.389375:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788625506.389793:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625506.390010:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788625506.390037:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788625506.390049:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788625506.390063:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788625506.390078:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788625506.390094:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788625506.390107:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788625506.390120:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788625506.390133:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788625506.390168:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788625506.390186:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788625506.390206:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788625506.390223:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788625506.390246:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788625506.390258:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788625506.390287:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788625506.390301:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788625506.390312:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788625506.390326:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788625506.390338:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788625506.390351:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788625506.390376:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788625506.390387:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788625506.390398:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788625506.390408:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788625506.393062:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788625506.393160:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788625506.393177:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788625506.393191:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788625506.393205:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788625506.393220:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788625506.393259:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788625506.393273:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788625506.393286:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788625506.393298:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788625506.393312:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788625506.393325:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788625506.393337:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788625506.393351:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788625506.393382:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788625506.393397:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788625506.393410:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788625506.393425:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788625506.393438:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788625506.393451:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788625506.393463:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788625506.393489:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788625506.393540:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788625506.393733:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788625506.393753:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788625506.393769:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788625506.393776:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788625506.393895:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625506.393972:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.394029:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.397865:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289536 00000100:00100000:0.0:1788625506.397889:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289536 00000100:00100000:0.0:1788625506.397969:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625506.397982:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625506.398244:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289536:12345-0@lo:501:mount.lustre.0 Request processed in 265us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.398254:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788625506.398331:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625506.398404:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625506.398460:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.399568:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.399608:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289664 00000100:00100000:0.0:1788625506.399617:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289664 00000100:00100000:0.0:1788625506.399675:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625506.399685:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625506.399849:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289664:12345-0@lo:503:mount.lustre.0 Request processed in 165us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.399856:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625506.399924:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625506.401616:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625506.401743:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.401834:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.401876:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.401902:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289792 00000100:00100000:0.0:1788625506.401909:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289792 00000100:00100000:0.0:1788625506.401949:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625506.401956:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.402149:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289792:12345-0@lo:502:mount.lustre.0 Request processed in 192us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.402171:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788625506.402229:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625506.403595:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788625506.403642:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788625506.403657:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788625506.403670:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788625506.403683:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788625506.403696:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788625506.403710:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788625506.403722:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788625506.403734:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788625506.403748:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788625506.403775:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788625506.403790:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788625506.403803:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788625506.403817:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788625506.403830:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788625506.403843:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788625506.403855:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788625506.403868:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788625506.403880:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788625506.403893:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788625506.403907:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788625506.403920:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788625506.403933:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788625506.403947:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788625506.403969:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788625506.403983:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788625506.404007:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788625506.404036:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788625506.404049:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788625506.404063:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788625506.404075:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788625506.404090:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788625506.404104:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788625506.404116:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788625506.404128:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788625506.404142:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788625506.404156:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788625506.404169:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788625506.404181:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788625506.404194:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788625506.404205:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788625506.404217:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788625506.404244:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788625506.404260:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788625506.404272:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788625506.404285:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788625506.404297:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788625506.404309:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788625506.404373:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.405011:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.405054:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.407478:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206289920 00000100:00100000:1.0:1788625506.407492:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206289920 00000100:00100000:1.0:1788625506.407560:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788625506.407571:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625506.407829:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206289920:12345-0@lo:502:mount.lustre.0 Request processed in 260us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.407838:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625506.410592:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206289920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625506.410856:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788625506.410887:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788625506.412631:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206290048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625506.412742:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625506.412799:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258780 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.412865:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290048 00000100:00100000:1.0:1788625506.412876:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290048 00000100:00100000:1.0:1788625506.412943:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625506.412954:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206290048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625506.413208:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206290048:12345-0@lo:502:mount.lustre.0 Request processed in 254us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.413218:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625506.413602:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206290048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788625506.413702:0:23530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788625506.413720:0:23530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788625506.416258:0:23548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788625506.416285:0:23548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9987434b19c0) 00000020:00000080:1.0:1788625506.416400:0:23548:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788625506.416822:0:23548:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998874b51800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788625506.416828:0:23548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998874b51800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788625506.416832:0:23548:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998874b51800 3 00010000:00080000:2.0:1788625506.416881:0:23548:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998743af2000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625506.420168:0:23548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788625506.420573:0:23548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788625506.420628:0:23548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788625506.420645:0:23548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2d2e3b3f34a7bedb 00000100:00080000:2.0:1788625506.420658:0:23548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625506.420665:0:23548:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998743af2000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625506.420711:0:23548:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99884435b800 x1875509206290176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625506.420760:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206290176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625506.420846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.420922:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290176 00000100:00100000:2.0:1788625506.420929:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290176 00000100:00100000:2.0:1788625506.420970:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625506.420979:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206290176:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788625506.421006:0:22799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1788625506.421051:0:22799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2d2e3b3f34a7bee2 00000004:00100000:2.0:1788625506.421226:0:22799:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788625506.421261:0:22799:0:(import.c:65:import_set_state_nolock()) ffff998743af0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625506.421317:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875509206290176:12345-0@lo:38:llog_process_th.0 Request processed in 338us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625506.421324:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788625506.421370:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99884435b800 x1875509206290176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625506.421379:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625506.421386:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788625506.421392:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788625506.421397:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788625506.421399:0:3634:0:(import.c:65:import_set_state_nolock()) ffff998743af2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625506.421404:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875509206290176:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788625506.421425:0:23548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788625506.421506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625506.421511:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625506.421514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625506.421543:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788625506.422282:0:23548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1788625506.422335:0:23530:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788625506.422382:0:23530:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625506.422403:0:23530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7becd expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625506.422417:0:23530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743541600/0x2d2e3b3f34a7bec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7becd expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625506.422624:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625506.422627:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625506.422629:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625506.422635:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625506.422636:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625506.422638:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625506.422639:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625506.422641:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625506.422642:0:23530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625506.422646:0:23530:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788625506.422649:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625506.422650:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625506.422651:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625506.422652:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625506.422653:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625506.422654:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625506.422654:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625506.422656:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625506.422656:0:23530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625506.422684:0:23530:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788625506.422706:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206290304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625506.422780:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625506.422816:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff998842577d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.425504:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290304 00000100:00100000:0.0:1788625506.425539:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290304 00000100:00100000:0.0:1788625506.425603:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788625506.425615:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206290304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788625506.425648:0:22792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788625506.425664:0:22792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788625506.433622:0:22779:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788625506.434058:0:22792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625506.434121:0:22815:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788625506.434127:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788625506.434150:0:22792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:3.0:1788625506.434151:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434177:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434185:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434191:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434232:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434248:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.434266:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206290432:0@lo:104: 00000100:00100000:3.0:1788625506.434348:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625506.434425:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434433:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.434442:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206290560:0@lo:104: 00000100:00100000:3.0:1788625506.434462:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.434488:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff998858237480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625506.434507:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290432 00000100:00100000:0.0:1788625506.434550:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290432 00000100:00100000:0.0:1788625506.434592:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290560 00000100:00100000:0.0:1788625506.434595:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290560 00000100:00100000:0.0:1788625506.434609:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625506.434618:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:22815:x1875509206290432:12345-0@lo:104: 00010000:00010000:0.0:1788625506.434668:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.434726:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625506.434733:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:22815:x1875509206290432:12345-0@lo:104: Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.434740:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625506.434756:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625506.434762:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206290560:12345-0@lo:104: 00010000:00010000:0.0:1788625506.434769:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.434797:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625506.434811:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206290560:12345-0@lo:104: Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.434817:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788625506.434826:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788625506.434880:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:23530:x1875509206290304:12345-0@lo:253:mount.lustre.0 Request processed in 9268us (12100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.434889:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788625506.434909:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434928:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625506.434933:0:22788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434942:0:22788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625506.434948:0:22788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625506.434954:0:22788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788625506.434987:0:22788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.434994:0:22788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788625506.435046:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206290688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625506.435077:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788625506.435122:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435131:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7beaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7beb1 expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435143:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625506.435146:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435152:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1788625506.435155:0:22788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435172:0:22788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625506.435174:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290688 00000100:00100000:0.0:1788625506.435178:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290688 10000000:00010000:3.0:1788625506.435179:0:22788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625506.435184:0:22788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625506.435194:0:22785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435202:0:22788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435207:0:22788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788625506.435214:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625506.435220:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:3636:x1875509206290688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625506.435221:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435228:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7bde6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bded expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625506.435229:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625506.435234:0:22785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435240:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625506.435242:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625506.435243:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625506.435243:0:22785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435250:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625506.435257:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625506.435261:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206290816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625506.435414:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:23530:1875509206290304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788625506.435438:0:23530:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788625506.435441:0:23530:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625506.435442:0:23530:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788625506.435444:0:23530:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625506.435445:0:23530:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625506.435447:0:23530:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625506.435448:0:23530:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625506.435449:0:23530:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788625506.435451:0:23530:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625506.435452:0:23530:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788625506.435468:0:23530:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788625506.435628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625506.435674:0:22786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788625506.435683:0:22786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788625506.435792:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683400/0x2d2e3b3f34a7beb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beaa expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.435803:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206290432:0@lo:104: 00000100:00100000:3.0:1788625506.435822:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206290560:0@lo:104: 00010000:00010000:3.0:1788625506.435846:0:22815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.435879:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290816 00000100:00100000:3.0:1788625506.435883:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290816 00010000:00010000:3.0:1788625506.435899:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.435958:0:22786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788625506.435967:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625506.435974:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:3637:x1875509206290816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625506.435985:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625506.435989:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.435999:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436011:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887da20600/0x2d2e3b3f34a7bded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bde6 expref: 18 pid: 22793 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436024:0:22786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436033:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788625506.436048:0:22786:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004287958s 00010000:00010000:3.0:1788625506.436053:0:22786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436066:0:22786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436073:0:22786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436080:0:22786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436086:0:22786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625506.436091:0:22786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436099:0:22786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436123:0:22786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436133:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625506.436189:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:3637:x1875509206290816:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625506.436196:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788625506.436217:0:22815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436224:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625506.436230:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7bee9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625506.436261:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206290816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625506.447771:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:3636:x1875509206290688:12345-0@lo:103:ldlm_bl.0 Request processed in 12539us (12681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625506.447787:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788625506.448909:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206290688:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788625506.456923:0:23530:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788625506.457299:0:23556:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788625506.458571:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788625506.459579:0:23530:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788625506.459975:0:23557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206290944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460091:0:23557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.460156:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206290944 00000100:00100000:1.0:1788625506.460164:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206290944 00000100:00100000:1.0:1788625506.460210:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625506.460219:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206290944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460315:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206290944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.460322:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625506.460346:0:23557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.460384:0:23557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206290944:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788625506.460415:0:23557:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788625506.460605:0:23557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206291072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460639:0:23557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.460662:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291072 00000100:00100000:1.0:1788625506.460666:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291072 00000100:00100000:1.0:1788625506.460683:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625506.460688:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206291072:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460789:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206291072:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.460795:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625506.460809:0:23557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.460821:0:23557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206291072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460872:0:23557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23557:1875509206291200:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.460898:0:23557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.460922:0:23557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000040:01000000:3.0:1788625506.461153:0:23530:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788625506.461198:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788625506.462078:0:23530:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788625506.462095:0:23530:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788625506.462156:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625506.463619:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291200 00000100:00100000:1.0:1788625506.463631:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291200 00000100:00100000:1.0:1788625506.463682:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625506.463691:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23557:x1875509206291200:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.463783:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23557:x1875509206291200:12345-0@lo:900:lod0001_rec0000.0 Request processed in 93us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.463790:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788625506.463831:0:23557:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9988442a5180 x1875509206291200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625522 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625506.463845:0:23557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23557:1875509206291200:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.463911:0:23557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206291328:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.463951:0:23557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625506.463976:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291328 00000100:00100000:1.0:1788625506.463979:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291328 00000100:00100000:1.0:1788625506.464001:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625506.464006:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206291328:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788625506.464068:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23557:x1875509206291328:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625506.464075:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00080000:0.0:1788625506.464082:0:23555:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788625506.464088:0:23555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788625506.464095:0:23557:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788625506.464106:0:23557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23557:1875509206291328:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788625506.464144:0:23557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625506.467718:0:23556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788625506.467823:0:23556:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788625506.468127:0:23530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788625506.468931:0:23530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788625506.468977:0:23530:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788625506.471016:0:23530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788625506.472036:0:23530:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1788625506.473599:0:23557:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788625506.473681:0:23557:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788625506.473685:0:23557:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1788625506.475790:0:23530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788625506.486767:0:23530:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788625506.486821:0:23530:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa6ab014e3988 00100000:10000000:2.0:1788625506.486832:0:23530:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788625506.489102:0:23530:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788625506.489145:0:23530:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788625506.489167:0:23530:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788625506.489193:0:23530:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788625506.493265:0:23530:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625506.493748:0:23530:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788625506.831358:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625507.407214:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625507.469215:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788625507.728559:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625507.728573:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998874b51800 from 12 10000000:01000000:3.0:1788625507.728582:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625507.728660:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.728678:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.728706:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625507.728746:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625507.728861:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625507.728940:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625507.729246:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291456 00000100:00100000:1.0:1788625507.729261:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291456 00000100:00100000:1.0:1788625507.729358:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788625507.729370:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:22796:x1875509206291456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625507.729390:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625507.729411:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bef0 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625507.729447:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625507.729461:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625507.729493:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743540400, rc 0) 00000100:00100000:1.0:1788625507.729593:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206291456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625507.729599:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625507.731407:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625507.731461:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.731478:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625507.731610:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625507.731948:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625507.732090:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625507.732152:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291584 00000100:00100000:1.0:1788625507.732161:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291584 00000100:00100000:1.0:1788625507.732235:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625507.732247:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206291584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625507.732274:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625507.732296:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625507.732299:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788625507.732430:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206291584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625507.732440:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788625507.733184:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788625507.733263:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788625507.733277:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.733290:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625507.733305:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625507.733308:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998872de2800 from 12 10000000:01000000:3.0:1788625507.733312:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625507.733365:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.733375:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.733386:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625507.733412:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625507.733487:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625507.733782:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625507.734190:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291712 00000100:00100000:2.0:1788625507.734201:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291712 00000100:00100000:2.0:1788625507.734315:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625507.734327:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206291712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625507.735123:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625507.735150:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7befe expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625507.735192:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625507.735207:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 18 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625507.735219:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:2.0:1788625507.735317:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206291712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 992us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625507.735326:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788625507.735457:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625507.735481:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625507.735493:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625507.735600:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625507.735645:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625507.736244:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988433a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788625507.736281:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291840 00000100:00100000:1.0:1788625507.736291:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291840 00000100:00100000:1.0:1788625507.736347:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788625507.736358:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206291840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625507.736379:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625507.736400:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625507.736404:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788625507.736511:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206291840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625507.736538:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788625507.736686:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206291840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788625507.736746:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788625507.736758:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625507.736769:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625507.853096:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788625508.429744:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625508.492812:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625508.875800:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788625509.451711:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625509.899987:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788625510.477711:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625510.924597:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 0 seconds 00000001:02000400:1.0:1788625511.208254:0:23800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788625511.500767:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788625511.692305:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788625511.692313:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788625511.692326:0:15724:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625511.692342:0:15724:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99887b47e000 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625511.692367:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998848a84380 x1875509206292096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625511.692386:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625511.692390:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625511.692392:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625511.692395:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625511.692423:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625511.692427:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625511.692429:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625511.692432:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788625511.692465:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.692573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.692628:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625511.692634:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.692667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.692699:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206292096:0@lo:38:kworker.0 00000100:00100000:0.0:1788625511.692722:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.692748:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206292224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.692787:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.692805:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625511.692821:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.692841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.692873:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206291968 00000100:00100000:0.0:1788625511.692881:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206291968 00000100:00100000:0.0:1788625511.692926:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625511.692935:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:3638:x1875509206291968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.692977:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:3638:x1875509206291968:12345-0@lo:400:kworker.0 Request processed in 43us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.692984:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788625511.693011:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292480 00000100:00100000:0.0:1788625511.693013:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292480 00000100:00100000:0.0:1788625511.693034:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292224 00000100:00100000:0.0:1788625511.693036:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292224 00000100:00100000:0.0:1788625511.693046:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625511.693052:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206292480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.693078:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206292480:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.693084:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788625511.693093:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625511.693098:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206292224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.693119:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206292224:12345-0@lo:400:kworker.0 Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.693125:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625511.693138:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292096 00000100:00100000:0.0:1788625511.693141:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292096 00000100:00100000:0.0:1788625511.693157:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292352 00000100:00100000:0.0:1788625511.693159:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292352 00000100:00100000:0.0:1788625511.693172:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625511.693176:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875509206292096:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788625511.693200:0:22804:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:0.0:1788625511.693236:0:22804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7bf0c 00000004:00100000:0.0:1788625511.693268:0:22804:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788625511.693276:0:22804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:0.0:1788625511.693409:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998848a84e00 x1875509206292224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625511.693425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206292224:0@lo:400:kworker.0 00010000:00080000:0.0:1788625511.693453:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998848a84000 x1875509206292480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625511.693460:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.693468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625511.694685:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206292608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625511.694754:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.696103:0:22805:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788625511.696115:0:22805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788625511.696657:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292608 00000100:00100000:0.0:1788625511.696666:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292608 00000100:00100000:2.0:1788625511.696802:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625511.696884:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206292352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625511.697031:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3635:x1875509206292352:12345-0@lo:400:kworker.0 Request processed in 218us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625511.697038:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625511.697057:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625511.697062:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206292608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625511.697087:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788625511.697136:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206292608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625511.697143:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625511.697230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206292608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625511.697705:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206292352:0@lo:400:kworker.0 00000100:00080000:0.0:1788625511.702023:0:22804:0:(import.c:65:import_set_state_nolock()) ffff99886085b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625511.702137:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206292096:12345-0@lo:38:kworker.0 Request processed in 8957us (9412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.702162:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788625511.702285:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788625511.702295:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788625511.702301:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788625511.702304:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887b47e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788625511.702333:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000018438d5e): req@ffff998743832300 x1875509206285184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625511.702394:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206292096:0@lo:38:kworker.0 00000100:00100000:0.0:1788625511.702582:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.702614:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625511.702715:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625511.702727:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206292736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625511.702755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625511.702784:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206285184 00000100:00100000:1.0:1788625511.702790:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206285184 00000100:00100000:1.0:1788625511.702824:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292736 00000100:00100000:1.0:1788625511.702826:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292736 00000100:00100000:1.0:1788625511.702840:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625511.702848:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22840:x1875509206285184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788625511.702917:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22840:x1875509206285184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625511.702925:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788625511.702936:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625511.702943:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206292736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625511.702961:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625511.702994:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875509206292736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625511.703000:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625511.703027:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206292736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625511.703102:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22840:1875509206285184:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788625511.703136:0:22840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788625511.703171:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22840:1875509206292864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788625511.703201:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.703221:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625511.703237:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292864 00000100:00100000:0.0:1788625511.703240:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292864 00000100:00100000:0.0:1788625511.703273:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625511.703280:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22840:x1875509206292864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788625511.703391:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22840:x1875509206292864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.703398:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788625511.703422:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22840:1875509206292864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788625511.703493:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22840:1875509206292992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788625511.703543:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625511.703557:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625511.703569:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206292992 00000100:00100000:0.0:1788625511.703573:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206292992 00000100:00100000:0.0:1788625511.703590:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625511.703595:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22840:x1875509206292992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788625511.703642:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22840:x1875509206292992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625511.703663:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788625511.703688:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22840:1875509206292992:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788625511.703727:0:22840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625511.705751:0:22840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788625511.705851:0:22840:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1788625511.705856:0:22840:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1788625512.151781:0:23853:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788625512.151974:0:23853:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788625512.523759:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625512.978754:0:23903:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625512.978967:0:23903:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788625513.547885:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625513.997111:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788625514.109432:0:23951:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc3a636b0 20000000:00000080:2.0:1788625514.109453:0:23951:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99884f30f800 uarg=0000000000000000 20000000:01000000:2.0:1788625514.109498:0:23951:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788625514.109514:0:23951:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788625514.109552:0:23951:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788625514.112356:0:23952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788625514.112563:0:23951:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788625514.120196:0:23951:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788625514.120386:0:23951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.120407:0:23951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.120416:0:23951:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.120424:0:23951:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.120475:0:23951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.120492:0:23951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 17 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625514.120507:0:23951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23951:1875509206293120:0@lo:104: 00000100:00100000:2.0:1788625514.121157:0:23951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625514.121258:0:23951:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.121280:0:23951:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625514.121292:0:23951:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23951:1875509206293248:0@lo:104: 00000100:00100000:2.0:1788625514.121313:0:23951:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625514.121446:0:23951:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625514.121541:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293120 00000100:00100000:0.0:1788625514.121549:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293120 00000100:00100000:0.0:1788625514.121588:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293248 00000100:00100000:0.0:1788625514.121592:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293248 00000100:00100000:0.0:1788625514.121607:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625514.121616:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:23951:x1875509206293120:12345-0@lo:104: 00010000:00010000:0.0:1788625514.121633:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625514.121696:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788625514.121702:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:23951:x1875509206293120:12345-0@lo:104: Request processed in 87us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625514.121708:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625514.121724:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625514.121730:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:23951:x1875509206293248:12345-0@lo:104: 00010000:00010000:0.0:1788625514.121737:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625514.121783:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788625514.121788:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:23951:x1875509206293248:12345-0@lo:104: Request processed in 59us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625514.121794:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625514.121879:0:23951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23951:1875509206293120:0@lo:104: 00000100:00100000:2.0:1788625514.121889:0:23951:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23951:1875509206293248:0@lo:104: 00010000:00010000:2.0:1788625514.121910:0:23951:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122007:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625514.122014:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122022:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625514.122026:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122046:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625514.122053:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625514.122059:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625514.122097:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122103:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625514.122122:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122129:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4c00/0x2d2e3b3f34a7beb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bebf expref: -99 pid: 23530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122139:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625514.122142:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122147:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625514.122150:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122156:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625514.122162:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625514.122172:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788625514.122186:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122192:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625514.122219:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122227:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7bdb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bdbc expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122240:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625514.122242:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625514.122243:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625514.122252:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625514.122262:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206293376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625514.122461:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625514.122510:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206293504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625514.122560:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625514.122604:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293376 00000100:00100000:1.0:1788625514.122610:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293376 00010000:00010000:1.0:1788625514.122639:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 18 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625514.122663:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293504 00000100:00100000:1.0:1788625514.122666:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293504 00010000:00010000:1.0:1788625514.122677:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 19 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625514.122708:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625514.122714:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:3635:x1875509206293376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625514.122728:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625514.122733:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 19 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122746:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 19 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122761:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887b683600/0x2d2e3b3f34a7bebf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7beb8 expref: 19 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122776:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625514.122808:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:3635:x1875509206293376:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625514.122816:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625514.122829:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625514.122836:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:3637:x1875509206293504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625514.122843:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625514.122848:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122856:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122865:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4600/0x2d2e3b3f34a7bdbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bdb5 expref: 17 pid: 22794 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122886:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122895:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122911:0:22784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122919:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.122926:0:22784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.123052:0:22784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.123059:0:22784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625514.123064:0:22784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.123072:0:22784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625514.123234:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625514.123379:0:23951:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625514.123389:0:23951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.124371:0:22784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.124387:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e4000/0x2d2e3b3f34a7bf13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625514.124416:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625514.124551:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:3637:x1875509206293504:12345-0@lo:103:ldlm_bl.0 Request processed in 1713us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625514.124560:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625514.124615:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206293376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625514.128406:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206293504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625514.573476:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625515.596004:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788625516.108583:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625516.108596:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998874b51800 from 13 10000000:01000000:2.0:1788625516.108605:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625516.108686:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.108702:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.108717:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625516.108753:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625516.109331:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625516.109407:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625516.109958:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293632 00000100:00100000:0.0:1788625516.109972:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293632 00000100:00100000:0.0:1788625516.110041:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788625516.110052:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+16:22796:x1875509206293632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625516.110074:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625516.110097:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bf1a expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.110133:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.110148:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 17 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.110160:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21a00, rc 0) 00000100:00100000:0.0:1788625516.113236:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206293632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3169us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625516.113253:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788625516.113577:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625516.113618:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625516.113635:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625516.113772:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625516.113853:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625516.113914:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625516.114707:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293760 00000100:00100000:0.0:1788625516.114721:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293760 00000100:00100000:0.0:1788625516.114787:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788625516.114800:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206293760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625516.115017:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206293760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625516.115026:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625516.115436:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625516.115513:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625516.115597:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625516.115634:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625516.115694:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206293888 00000100:00100000:0.0:1788625516.115701:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206293888 00000100:00100000:0.0:1788625516.115741:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788625516.115749:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206293888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625516.115848:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206293888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625516.115927:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788625516.116005:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206293888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625516.117993:0:24051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788625516.118274:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788625516.118304:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625516.118320:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.118336:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625516.118351:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788625516.118354:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998872de2800 from 13 10000000:01000000:0.0:1788625516.118357:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788625516.118408:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.118418:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.118430:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625516.118473:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625516.118613:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625516.118662:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625516.118703:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294016 00000100:00100000:2.0:1788625516.118713:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294016 00000100:00100000:2.0:1788625516.118772:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788625516.118783:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+17:22796:x1875509206294016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625516.118807:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625516.118824:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bf28 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.118854:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 18 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.118868:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 18 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.118878:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5800, rc 0) 00000100:00100000:2.0:1788625516.118931:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206294016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625516.118939:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788625516.119022:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625516.119039:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625516.119050:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625516.119125:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625516.119159:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625516.119189:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851ba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625516.119214:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294144 00000100:00100000:2.0:1788625516.119220:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294144 00000100:00100000:2.0:1788625516.119261:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625516.119270:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206294144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625516.119399:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206294144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625516.119407:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788625516.119436:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625516.119467:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625516.119506:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625516.119720:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998878108000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625516.119734:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294272 00000100:00100000:2.0:1788625516.119738:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294272 00000100:00100000:2.0:1788625516.119765:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625516.119771:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206294272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788625516.119860:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:22796:x1875509206294272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625516.119867:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788625516.119911:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206294272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788625516.121388:0:24052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788625516.121479:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788625516.121510:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625516.121864:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625516.121879:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625516.621688:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625516.812287:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206294400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625516.813585:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625516.813666:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625516.813679:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206294528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625516.813720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625516.813752:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625506/real 1788625506] req@ffff998743833b80 x1875509206288384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813776:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743833b80 x1875509206288384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813787:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625506/real 1788625506] req@ffff998743833100 x1875509206288256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813821:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743833100 x1875509206288256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813831:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625501/real 1788625501] req@ffff998848a84a80 x1875509206286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813846:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998848a84a80 x1875509206286208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813855:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625501/real 1788625501] req@ffff998848a87b80 x1875509206286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.813867:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998848a87b80 x1875509206286336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625516 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625516.813880:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625516.813889:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625516.813893:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206288384:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788625516.813900:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625516.813904:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625516.813907:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206288256:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788625516.813911:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625516.813915:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625516.813933:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286208:0@lo:8:kworker.0 00000100:00080000:0.0:1788625516.813937:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625516.813941:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625516.813945:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206286336:0@lo:8:kworker.0 00000100:00100000:0.0:1788625516.813991:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294400 00000100:00100000:0.0:1788625516.814001:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294400 00000100:00100000:0.0:1788625516.814053:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294528 00000100:00100000:0.0:1788625516.814056:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294528 00000100:00100000:0.0:1788625516.814075:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625516.814085:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206294400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625516.814128:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625516.814223:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625516.814234:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206294528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625516.814260:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788625516.814303:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206294528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625516.814310:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788625516.814381:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206294528:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788625516.814528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625516.814533:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788625516.814536:0:37:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625516.814541:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:3.0:1788625516.814546:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625516.814550:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9988582ec800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625516.814579:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743833480 x1875509206294656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625516.814595:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625516.814598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625516.814600:0:37:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625516.814603:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:3.0:1788625516.814606:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788625516.814609:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9987438d1800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625516.814621:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743831500 x1875509206294784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625516.814640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625516.814642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788625516.814644:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625516.814647:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 627 00000100:00080000:3.0:1788625516.814649:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625516.814652:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625516.814661:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743832680 x1875509206295040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625516.814668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625516.814677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625516.814679:0:37:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788625516.814682:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 627 00000100:00080000:3.0:1788625516.814684:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788625516.814688:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887ca90800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625516.814698:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743833100 x1875509206295168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625516.814770:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625516.814781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206294912:0@lo:400:kworker.0 00000100:00100000:1.0:1788625516.814815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625516.814862:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206295296:0@lo:400:kworker.0 00000100:00100000:1.0:1788625516.814887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625516.814915:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206294656:0@lo:8:kworker.0 00000400:00000100:1.0:1788625516.814935:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206294656 offset 0 length 520: 4 00000100:00100000:1.0:1788625516.814957:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206294784:0@lo:8:kworker.0 00000400:00000100:1.0:1788625516.814975:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206294784 offset 0 length 520: 4 00000100:00100000:1.0:1788625516.814984:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206295040:0@lo:8:kworker.0 00000400:00000100:1.0:1788625516.815000:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206295040 offset 0 length 520: 4 00000100:00100000:1.0:1788625516.815009:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206295168:0@lo:8:kworker.0 00000400:00000100:1.0:1788625516.815026:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875509206295168 offset 0 length 520: 4 00000100:00100000:0.0:1788625516.815070:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206294912 00000100:00100000:0.0:1788625516.815077:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206294912 00000100:00100000:1.0:1788625516.815093:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206294400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1008us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625516.815102:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625516.815112:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295296 00000100:00100000:0.0:1788625516.815116:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295296 00000100:00100000:0.0:1788625516.815135:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625516.815144:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206294912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625516.815146:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206294400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625516.815203:0:22799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788625516.815206:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206294912:12345-0@lo:400:kworker.0 Request processed in 64us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625516.815217:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788625516.815220:0:22799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788625516.815237:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625516.815245:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206295296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625516.815283:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206295296:12345-0@lo:400:kworker.0 Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625516.815291:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788625516.815321:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998743833b80 x1875509206295296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.815333:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206295296:0@lo:400:kworker.0 00010000:00080000:0.0:1788625516.815360:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998743831f80 x1875509206294912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625516.815382:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206294912:0@lo:400:kworker.0 00010000:00010000:1.0:1788625517.645371:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788625517.837805:0:23531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788625518.673713:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625518.732161:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788625519.697330:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788625520.139217:0:24300:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788625520.139223:0:24300:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788625520.139225:0:24300:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788625520.139375:0:24300:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99885ee8a800 00000020:01000004:2.0:1788625520.139398:0:24300:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788625520.139416:0:24300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788625520.139436:0:24300:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99887cb199c0) 00000020:00000080:2.0:1788625520.139459:0:24300:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788625520.185904:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788625520.189818:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788625520.190406:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788625520.190711:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788625520.190982:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788625520.191307:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788625520.191624:0:24300:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788625520.194293:0:24300:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788625520.194985:0:24300:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788625520.195005:0:24300:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788625520.195026:0:24300:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7bf3d 00000020:01000004:0.0:1788625520.195036:0:24300:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788625520.195068:0:24300:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788625520.195072:0:24300:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788625520.195079:0:24300:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788625520.195096:0:24300:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788625520.195114:0:24300:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9988449d19c0) 00000020:00000080:0.0:1788625520.195131:0:24300:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788625520.196905:0:24300:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788625520.201147:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788625520.201159:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788625520.202358:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788625520.202368:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788625520.211126:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788625520.211152:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788625520.216244:0:24300:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625520.216479:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788625520.216486:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788625520.217468:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625520.217476:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788625520.239002:0:24300:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625520.239265:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788625520.239272:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788625520.240966:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788625520.240979:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788625520.242351:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788625520.242363:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788625520.248227:0:24300:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788625520.248439:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788625520.248445:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788625520.250950:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625520.250964:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788625520.293765:0:24300:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788625520.294004:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788625520.294013:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788625520.295695:0:24300:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788625520.295707:0:24300:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788625520.296427:0:24300:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788625520.296461:0:24300:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788625520.296468:0:24300:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788625520.314236:0:24300:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788625520.314299:0:24300:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.114@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788625520.314305:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788625520.314307:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625520.314309:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625520.314310:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625520.314312:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625520.314313:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625520.314315:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625520.314316:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625520.314318:0:24300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625520.314322:0:24300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788625520.314324:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788625520.314326:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625520.314327:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625520.314328:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625520.314329:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625520.314330:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625520.314331:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625520.314332:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625520.314333:0:24300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788625520.314440:0:24300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788625520.314466:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625520.314588:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.314658:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.314675:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295424 00000100:00100000:2.0:1788625520.314820:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295424 00000100:00100000:2.0:1788625520.314893:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788625520.314904:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:24300:x1875509206295424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625520.314952:0:22793:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788625520.314956:0:22793:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788625520.315029:0:22793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788625520.316174:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:24300:x1875509206295424:12345-0@lo:253:mount.lustre.0 Request processed in 1265us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.316187:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788625520.316451:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788625520.316470:0:24300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788625520.316474:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788625520.316477:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788625520.316478:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788625520.316480:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788625520.316481:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788625520.316483:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788625520.316485:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788625520.316487:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788625520.316489:0:24300:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788625520.316537:0:24300:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99885ee8a800 from lustre-OST0000 10000000:01000000:3.0:1788625520.316588:0:24300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788625520.316592:0:24300:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788625520.316604:0:24300:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998844238000 local copy 00010000:00010000:3.0:1788625520.316619:0:24300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625520.316879:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.316927:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625520.317007:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295552 00000100:00100000:0.0:1788625520.317015:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295552 00000100:00100000:0.0:1788625520.317056:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788625520.317067:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:24300:x1875509206295552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.317129:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.317278:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:24300:x1875509206295552:12345-0@lo:501:mount.lustre.0 Request processed in 212us (350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625520.317286:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788625520.317490:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295552:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788625520.317506:0:24300:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788625520.317590:0:24300:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788625520.317599:0:24300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.317609:0:24300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625520.317640:0:24300:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99885ee8a800 10000000:01000000:3.0:1788625520.317652:0:24300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788625520.317659:0:24300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788625520.317661:0:24300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625520.317666:0:24300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788625520.317669:0:24300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788625520.317751:0:24300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.317760:0:24300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.317770:0:24300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625520.317785:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625520.317816:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.317941:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.317974:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295680 00000100:00100000:0.0:1788625520.317978:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295680 00000100:00100000:0.0:1788625520.318046:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788625520.318054:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+18:24300:x1875509206295680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625520.318065:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625520.318080:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20400/0x2d2e3b3f34a7bf52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bf4b expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.318116:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20400/0x2d2e3b3f34a7bf52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf4b expref: 19 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.318129:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20400/0x2d2e3b3f34a7bf52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf4b expref: 19 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.318139:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20400, rc 0) 00000100:00100000:0.0:1788625520.318212:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206295680:12345-0@lo:101:mount.lustre.0 Request processed in 158us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625520.318218:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788625520.318286:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625520.318300:0:24300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf52 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.318311:0:24300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf52 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625520.319574:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788625520.320430:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625520.322787:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788625520.323469:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788625520.323490:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788625520.323505:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788625520.323567:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788625520.323583:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788625520.323598:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788625520.323611:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788625520.323623:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788625520.323636:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788625520.323650:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788625520.323664:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788625520.323742:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788625520.323749:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788625520.323951:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.324038:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.324188:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645240 going to sleep for 11 seconds 00000100:00100000:1.0:1788625520.324288:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295808 00000100:00100000:1.0:1788625520.324297:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295808 00000100:00100000:1.0:1788625520.324407:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788625520.324419:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206295808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625520.324670:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206295808:12345-0@lo:501:mount.lustre.0 Request processed in 252us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.324699:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788625520.324798:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.324844:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625520.324886:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.325289:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885e645240 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.325319:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206295936 00000100:00100000:0.0:1788625520.325326:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206295936 00000100:00100000:0.0:1788625520.325421:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788625520.325431:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206295936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625520.326324:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206295936:12345-0@lo:503:mount.lustre.0 Request processed in 889us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625520.326343:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788625520.326495:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206295936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625520.327348:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625520.327631:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625520.327727:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.327828:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.327875:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296064 00000100:00100000:2.0:1788625520.327884:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296064 00000100:00100000:2.0:1788625520.327942:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788625520.327953:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206296064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.328550:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206296064:12345-0@lo:502:mount.lustre.0 Request processed in 597us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.328560:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788625520.328798:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625520.329119:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788625520.329182:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788625520.329199:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788625520.329213:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788625520.329234:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788625520.329246:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788625520.329257:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788625520.329269:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788625520.329282:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788625520.329294:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788625520.329308:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788625520.329321:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788625520.329884:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625520.329976:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.330093:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743861e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.330138:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296192 00000100:00100000:0.0:1788625520.330215:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296192 00000100:00100000:0.0:1788625520.330332:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788625520.330345:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206296192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625520.330880:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206296192:12345-0@lo:502:mount.lustre.0 Request processed in 533us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.330890:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788625520.330985:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625520.331127:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788625520.331143:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788625520.332712:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788625520.332728:0:24317:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788625520.332738:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788625520.332741:0:24317:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788625520.332749:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788625520.332776:0:24317:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99887b4899c0) 00000020:00000080:1.0:1788625520.332810:0:24317:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788625520.332817:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788625520.332934:0:24317:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99885ee8a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788625520.332943:0:24317:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788625520.332953:0:24317:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2d2e3b3f34a7bf60 00010000:00010000:1.0:1788625520.337283:0:24317:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788625520.338078:0:24317:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788625520.340506:0:24317:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788625520.342430:0:24317:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788625520.342446:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625520.342454:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342456:0:24317:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788625520.342460:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788625520.342464:0:24317:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788625520.342466:0:24317:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625520.342467:0:24317:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788625520.342469:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788625520.342471:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342473:0:24317:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788625520.342475:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625520.342479:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342480:0:24317:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788625520.342492:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788625520.342494:0:24317:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788625520.342496:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625520.342499:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342501:0:24317:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788625520.342503:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788625520.342505:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342507:0:24317:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788625520.342510:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788625520.342585:0:24317:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788625520.342589:0:24317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625520.342591:0:24317:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788625520.342595:0:24317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788625520.342969:0:24300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788625520.343014:0:24300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788625520.343041:0:24300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf52 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.343056:0:24300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682e00/0x2d2e3b3f34a7bf4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf52 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625520.343068:0:24300:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99885ee8a800 from 1 10000000:01000000:3.0:1788625520.343072:0:24300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625520.343134:0:24300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.343144:0:24300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.343175:0:24300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625520.343210:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625520.343303:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.343553:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296320 00000100:00100000:2.0:1788625520.343562:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296320 00000100:00100000:3.0:1788625520.343685:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.343738:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788625520.343751:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:24300:x1875509206296320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625520.343767:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625520.343784:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bf67 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.343813:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 20 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.343826:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 20 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.343835:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5e00, rc 0) 00000100:00100000:2.0:1788625520.343893:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296320:12345-0@lo:101:mount.lustre.0 Request processed in 143us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.343900:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788625520.343995:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625520.344013:0:24300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.344025:0:24300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625520.346116:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788625520.346599:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625520.346805:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788625520.346830:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788625520.346842:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788625520.346854:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788625520.346872:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788625520.346883:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788625520.346896:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788625520.346909:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788625520.346921:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788625520.346932:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788625520.346943:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788625520.346957:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788625520.346962:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788625520.347050:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.347224:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.347339:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.347387:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296448 00000100:00100000:2.0:1788625520.347396:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296448 00000100:00100000:2.0:1788625520.347494:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788625520.347507:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625520.347674:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296448:12345-0@lo:501:mount.lustre.0 Request processed in 169us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.347683:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788625520.347798:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.347843:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625520.347893:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.347953:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296576 00000100:00100000:3.0:1788625520.347954:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.347958:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296576 00000100:00100000:2.0:1788625520.348010:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788625520.348019:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625520.348130:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296576:12345-0@lo:503:mount.lustre.0 Request processed in 112us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.348137:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788625520.348218:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788625520.348760:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788625520.348834:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625520.348874:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.348946:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.348985:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296704 00000100:00100000:2.0:1788625520.348989:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296704 00000100:00100000:2.0:1788625520.349060:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788625520.349070:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.349247:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296704:12345-0@lo:502:mount.lustre.0 Request processed in 177us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.349255:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788625520.349501:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625520.349756:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788625520.349785:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788625520.349822:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788625520.349841:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788625520.349859:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788625520.349876:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788625520.349894:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788625520.349910:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788625520.349929:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788625520.349948:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788625520.349965:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788625520.349995:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625520.350043:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.350099:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.350200:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296832 00000100:00100000:2.0:1788625520.350207:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296832 00000100:00100000:2.0:1788625520.350245:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625520.350254:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.350350:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296832:12345-0@lo:502:mount.lustre.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.350368:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788625520.350632:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625520.350691:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788625520.350700:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788625520.351470:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625520.351482:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351485:0:24321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625520.351493:0:24321:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99885ee8a800 00000020:00000080:3.0:1788625520.351497:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625520.351508:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625520.351512:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351513:0:24321:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625520.351591:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625520.351613:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351615:0:24321:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625520.351619:0:24321:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99885ee8a800 00000020:00000080:3.0:1788625520.351621:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625520.351676:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625520.351680:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351682:0:24321:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625520.351684:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625520.351687:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351688:0:24321:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625520.351691:0:24321:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99885ee8a800 00000020:00000080:3.0:1788625520.351693:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625520.351722:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625520.351725:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351727:0:24321:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625520.351730:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625520.351732:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351734:0:24321:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625520.351737:0:24321:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99885ee8a800 00000020:00000080:3.0:1788625520.351739:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625520.351761:0:24321:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625520.351763:0:24321:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625520.351765:0:24321:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625520.351768:0:24321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788625520.351933:0:24300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788625520.351965:0:24300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625520.352020:0:24300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.352035:0:24300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625520.352108:0:24300:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788625520.352112:0:24300:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99885ee8a800 10000000:01000000:2.0:1788625520.352115:0:24300:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99885ee8a800 10000000:01000000:2.0:1788625520.352121:0:24300:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788625520.352128:0:24300:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99885ee8a800 from 1 10000000:01000000:2.0:1788625520.352132:0:24300:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788625520.352253:0:24300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.352263:0:24300:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.352273:0:24300:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625520.352298:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788625520.352376:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.352428:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.353318:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206296960 00000100:00100000:0.0:1788625520.353333:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206296960 00000100:00100000:0.0:1788625520.355039:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788625520.355058:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:24300:x1875509206296960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625520.355096:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625520.355124:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da21600/0x2d2e3b3f34a7bf7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bf75 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.355165:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da21600/0x2d2e3b3f34a7bf7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf75 expref: 21 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.355179:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da21600/0x2d2e3b3f34a7bf7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf75 expref: 21 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625520.355190:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21600, rc 0) 00000100:00100000:0.0:1788625520.355294:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206296960:12345-0@lo:101:mount.lustre.0 Request processed in 242us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625520.355302:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788625520.355497:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206296960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625520.355541:0:24300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf7c expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.355555:0:24300:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bf7c expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625520.358254:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788625520.358651:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625520.358927:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788625520.358955:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788625520.358968:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788625520.358980:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788625520.358994:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788625520.359007:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788625520.359022:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788625520.359034:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788625520.359046:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788625520.359058:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788625520.359070:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788625520.359095:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788625520.359110:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788625520.359133:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788625520.359147:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788625520.359169:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788625520.359181:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788625520.359212:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788625520.359227:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788625520.359242:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788625520.359266:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788625520.359280:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788625520.359293:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788625520.359308:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788625520.359323:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788625520.359337:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788625520.359350:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788625520.359363:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788625520.359377:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788625520.359392:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788625520.359411:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788625520.359431:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788625520.359450:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788625520.359483:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788625520.359506:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788625520.359559:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788625520.359579:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788625520.359593:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788625520.359605:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788625520.359616:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788625520.359628:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788625520.359639:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788625520.359654:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788625520.359669:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788625520.359684:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788625520.359698:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788625520.359715:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788625520.359731:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788625520.359906:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788625520.359931:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788625520.359954:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788625520.359960:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788625520.360078:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625520.360199:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.360268:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625520.360490:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297088 00000100:00100000:3.0:1788625520.360508:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297088 00000100:00100000:3.0:1788625520.360600:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788625520.360612:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625520.360794:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297088:12345-0@lo:501:mount.lustre.0 Request processed in 183us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625520.360803:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788625520.361660:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625520.361729:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625520.361804:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.361850:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.362660:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297216 00000100:00100000:0.0:1788625520.362673:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297216 00000100:00100000:0.0:1788625520.362756:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788625520.362766:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625520.363461:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297216:12345-0@lo:503:mount.lustre.0 Request processed in 629us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625520.363473:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788625520.365334:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788625520.366015:0:24300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788625520.366150:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.366257:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.366320:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297344 00000100:00100000:2.0:1788625520.366327:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297344 00000100:00100000:2.0:1788625520.366385:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625520.366396:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.366544:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297344:12345-0@lo:502:mount.lustre.0 Request processed in 150us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.366552:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788625520.366615:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.366635:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625520.366844:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788625520.366874:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788625520.366890:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788625520.366902:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788625520.366914:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788625520.366929:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788625520.366942:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788625520.366967:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788625520.366979:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788625520.366991:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788625520.367002:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788625520.367028:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788625520.367042:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788625520.367054:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788625520.367066:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788625520.367076:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788625520.367105:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788625520.367120:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788625520.367133:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788625520.367146:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788625520.367161:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788625520.367175:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788625520.367187:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788625520.367199:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788625520.367212:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788625520.367226:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788625520.367240:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788625520.367266:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788625520.367279:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788625520.367291:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788625520.367302:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788625520.367314:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788625520.367326:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788625520.367338:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788625520.367351:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788625520.367363:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788625520.367375:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788625520.367387:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788625520.367399:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788625520.367411:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788625520.367435:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788625520.367449:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788625520.367471:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788625520.367499:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788625520.367538:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788625520.367555:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788625520.367567:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788625520.367578:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788625520.367618:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.367684:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.367711:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625520.367750:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297472 00000100:00100000:0.0:1788625520.367987:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297472 00000100:00100000:0.0:1788625520.368047:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788625520.368058:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625520.368262:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297472:12345-0@lo:502:mount.lustre.0 Request processed in 205us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625520.368270:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788625520.370897:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625520.371239:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788625520.371273:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788625520.371325:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.371492:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.371564:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297600 00000100:00100000:2.0:1788625520.371572:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297600 00000100:00100000:2.0:1788625520.371640:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788625520.371652:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625520.372169:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206297600:12345-0@lo:502:mount.lustre.0 Request processed in 517us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.372178:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788625520.372245:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.372266:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206297600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788625520.372332:0:24300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788625520.372344:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788625520.374590:0:24325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788625520.374614:0:24325:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99887cb18000) 00000020:00000080:2.0:1788625520.374649:0:24325:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788625520.374778:0:24325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99885ee8a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625520.374784:0:24325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99885ee8a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788625520.374787:0:24325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99885ee8a800 3 00010000:00080000:2.0:1788625520.374834:0:24325:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99874383d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625520.378349:0:24325:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788625520.379095:0:24325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788625520.379325:0:24325:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788625520.379347:0:24325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2d2e3b3f34a7bf8a 00000100:00080000:2.0:1788625520.379413:0:24325:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625520.379422:0:24325:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99874383d800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625520.379472:0:24325:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99884435b800 x1875509206297728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625520.379505:0:24325:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788625520.379595:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625520.379600:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625520.379603:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625520.379606:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625520.379650:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625520.379654:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625520.379657:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625520.379660:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788625520.379724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206297856:0@lo:400:kworker.0 00000100:00100000:2.0:1788625520.379828:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.379875:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625520.379882:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206298240:0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.379916:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206297728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625520.379917:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.379968:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206297984:0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.379969:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.380012:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625520.380037:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298240 00000100:00100000:2.0:1788625520.380040:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625520.380047:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298240 00000100:00100000:2.0:1788625520.380048:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206298112:0@lo:400:kworker.0 00000100:00100000:2.0:1788625520.380095:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625520.380118:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297728 00000100:00100000:1.0:1788625520.380123:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297728 00000100:00100000:1.0:1788625520.380143:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297984 00000100:00100000:1.0:1788625520.380146:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297984 00000100:00100000:1.0:1788625520.380166:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625520.380177:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206298240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.380412:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206298240:12345-0@lo:400:kworker.0 Request processed in 236us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.380427:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625520.380448:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625520.380456:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206297984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.380494:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206297984:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.380501:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625520.380514:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625520.380548:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875509206297728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788625520.380576:0:22799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:1.0:1788625520.380630:0:22799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7bf91 00000004:00100000:1.0:1788625520.380653:0:22799:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788625520.380656:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206297856 00000100:00100000:2.0:1788625520.380663:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206297856 00000100:00080000:1.0:1788625520.380702:0:22799:0:(import.c:65:import_set_state_nolock()) ffff998742682000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625520.380704:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298112 00000100:00100000:2.0:1788625520.380710:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298112 00000100:00100000:2.0:1788625520.380729:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625520.380738:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206297856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.380755:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875509206297728:12345-0@lo:38:llog_process_th.0 Request processed in 204us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.380784:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206297856:12345-0@lo:400:kworker.0 Request processed in 48us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.380792:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625520.380806:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625520.380812:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206298112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625520.380852:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206298112:12345-0@lo:400:kworker.0 Request processed in 41us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625520.380859:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788625520.380992:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788625520.381044:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99884435b800 x1875509206297728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625520.381056:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625520.381067:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788625520.381076:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788625520.381093:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788625520.381096:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99874383d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625520.381103:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875509206297728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625520.381146:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206298112:0@lo:400:kworker.0 00010000:00080000:1.0:1788625520.381170:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998844359c00 x1875509206297984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625520.381180:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206297984:0@lo:400:kworker.0 00010000:00080000:1.0:1788625520.381215:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998844359500 x1875509206298240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625520.381238:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206298240:0@lo:400:kworker.0 00000100:00100000:1.0:1788625520.381250:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206297856:0@lo:400:kworker.0 00000020:01000004:3.0:1788625520.381790:0:24325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788625520.381812:0:24325:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9988739499c0) 00000020:00000080:3.0:1788625520.381840:0:24325:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788625520.381947:0:24325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99885ee8a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625520.381953:0:24325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99885ee8a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788625520.381956:0:24325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99885ee8a800 3 00010000:00080000:3.0:1788625520.381991:0:24325:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99887f8c1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.114@tcp at head 00010000:00010000:3.0:1788625520.389115:0:24325:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788625520.389384:0:24325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788625520.389453:0:24325:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788625520.389471:0:24325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2d2e3b3f34a7bf9f 00000100:00080000:3.0:1788625520.389484:0:24325:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788625520.389492:0:24325:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99887f8c1800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625520.389569:0:24325:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743831880 x1875509206298368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788625520.389600:0:24325:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788625520.390078:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206298368:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788625520.390193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625520.391375:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298368 00000100:00100000:3.0:1788625520.391394:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298368 00000100:00100000:3.0:1788625520.391449:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788625520.391460:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206298368:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625520.391502:0:22801:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:3.0:1788625520.391596:0:22801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2d2e3b3f34a7bfa6 00000004:00100000:3.0:1788625520.391624:0:22801:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625520.391671:0:22801:0:(import.c:65:import_set_state_nolock()) ffff99887f8c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625520.391764:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875509206298368:12345-0@lo:38:llog_process_th.0 Request processed in 303us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625520.391772:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625520.392183:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998743831880 x1875509206298368/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625520.392197:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625520.392208:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788625520.392217:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788625520.392223:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788625520.392225:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887f8c1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788625520.392232:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875509206298368:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788625520.392414:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:3.0:1788625520.392569:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625520.392575:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625520.392578:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625520.392581:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625520.392585:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625520.392589:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625520.392591:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625520.392594:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788625520.392811:0:24300:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788625520.392851:0:24300:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625520.392876:0:24300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf7c expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625520.392903:0:24300:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e4000/0x2d2e3b3f34a7bf75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bf7c expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625520.392960:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625520.392963:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788625520.392965:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625520.392966:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625520.392968:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625520.392969:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625520.392971:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625520.392974:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625520.392976:0:24300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625520.392981:0:24300:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788625520.392984:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625520.392985:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788625520.392986:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625520.392988:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625520.392989:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625520.392990:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625520.392991:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625520.392992:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625520.392993:0:24300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625520.393019:0:24300:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788625520.393041:0:24300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206298496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788625520.393117:0:24300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625520.393159:0:24300:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625520.393182:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298496 00000100:00100000:2.0:1788625520.393188:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298496 00000100:00100000:2.0:1788625520.393232:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788625520.393241:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206298496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625520.393270:0:22793:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788625520.393289:0:22793:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625520.407023:0:22793:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625520.407049:0:22793:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788625520.407215:0:22815:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625520.407223:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625520.407257:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407283:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 21 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407314:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407323:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407379:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407395:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 21 pid: 22793 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.407413:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206298624:0@lo:104: 00000100:00100000:1.0:1788625520.407505:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625520.407602:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 21 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.407611:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 21 pid: 22794 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.407619:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206298752:0@lo:104: 00000100:00100000:1.0:1788625520.407648:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625520.407671:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988488f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625520.407776:0:22783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788625520.407801:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298624 00000100:00100000:3.0:1788625520.407810:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298624 00000100:00100000:3.0:1788625520.407853:0:22783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298752 00000100:00100000:3.0:1788625520.407857:0:22783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298752 00000100:00100000:3.0:1788625520.407873:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625520.407883:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:22815:x1875509206298624:12345-0@lo:104: 00010000:00010000:3.0:1788625520.407901:0:22783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.407990:0:22783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625520.407998:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:22815:x1875509206298624:12345-0@lo:104: Request processed in 117us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625520.408007:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625520.408027:0:22783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625520.408033:0:22783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998851f13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206298752:12345-0@lo:104: 00010000:00010000:3.0:1788625520.408041:0:22783:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625520.408106:0:22783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625520.408113:0:22783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998851f13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206298752:12345-0@lo:104: Request processed in 80us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625520.408119:0:22783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625520.408215:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:24300:x1875509206298496:12345-0@lo:253:mount.lustre.0 Request processed in 14975us (15098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625520.408225:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:1.0:1788625520.408296:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625520.408304:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408312:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625520.408318:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408335:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625520.408342:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625520.408348:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625520.408392:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408400:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625520.408426:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408434:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683c00/0x2d2e3b3f34a7befe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf05 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408450:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625520.408454:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408459:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1788625520.408462:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408469:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788625520.408475:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625520.408488:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788625520.408551:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408558:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788625520.408574:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408582:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683400/0x2d2e3b3f34a7bef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bef7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408598:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625520.408600:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625520.408602:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625520.408609:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625520.408624:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206298880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625520.408662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625520.408710:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206299008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625520.408735:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625520.408772:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206298880 00000100:00100000:1.0:1788625520.408778:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206298880 00010000:00010000:1.0:1788625520.408805:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 21 pid: 22793 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.408830:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299008 00000100:00100000:1.0:1788625520.408833:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299008 00010000:00010000:1.0:1788625520.408845:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 22 pid: 22794 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.408878:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625520.408885:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:3638:x1875509206298880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625520.408899:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625520.408904:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 22 pid: 22793 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408916:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 22 pid: 22793 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.408936:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625520.408965:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:3638:x1875509206298880:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.408972:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625520.408988:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625520.408994:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3635:x1875509206299008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625520.409002:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625520.409007:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 21 pid: 22794 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409015:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 21 pid: 22794 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409029:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409039:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788625520.409066:0:22784:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004287958s 00010000:00010000:1.0:1788625520.409071:0:22784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409079:0:22784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409097:0:22784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409105:0:22784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409110:0:22784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743540000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625520.409115:0:22784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409123:0:22784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409131:0:22784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409142:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625520.409171:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3635:x1875509206299008:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625520.409177:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625520.409250:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206299008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625520.409278:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206298880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625520.409313:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bf05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7befe expref: 20 pid: 22793 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.409324:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206298624:0@lo:104: 00010000:00010000:1.0:1788625520.409338:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7bef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bef0 expref: 19 pid: 22794 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625520.409347:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206298752:0@lo:104: 00010000:00010000:1.0:1788625520.409361:0:22815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409371:0:22815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409378:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625520.409384:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625520.409833:0:24300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:24300:1875509206298496:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788625520.409848:0:24300:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788625520.409852:0:24300:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625520.409854:0:24300:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788625520.409856:0:24300:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625520.409857:0:24300:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625520.409859:0:24300:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625520.409860:0:24300:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625520.409862:0:24300:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625520.409864:0:24300:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625520.409866:0:24300:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788625520.409879:0:24300:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788625520.418827:0:24300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788625520.425065:0:24300:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788625520.425091:0:24300:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788625520.425142:0:24300:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625520.425210:0:24300:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625520.425238:0:24300:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788625520.425278:0:24300:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788625520.426297:0:24300:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625520.426614:0:24300:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625520.715739:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625521.170461:0:24378:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625521.171208:0:24378:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788625521.741229:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625521.931930:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788625521.931955:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206299136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625521.932720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206299264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625521.932768:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625521.932835:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299264 00000100:00100000:2.0:1788625521.932843:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299264 00000100:00100000:2.0:1788625521.932889:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625521.932898:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206299264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625521.932932:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788625521.932977:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206299264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625521.932984:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788625521.933045:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206299264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625521.933124:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625521.934151:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299136 00000100:00100000:2.0:1788625521.934158:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299136 00000100:00100000:2.0:1788625521.934195:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788625521.934204:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206299136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625521.934503:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625521.934598:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206299136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 394us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625521.934607:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788625521.934783:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206299136:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1788625522.059706:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788625522.059714:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998874b51800 from 13 10000000:01000000:3.0:1788625522.059720:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788625522.059794:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625522.059806:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625522.059818:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625522.059843:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625522.059913:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625522.059960:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625522.060075:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299392 00000100:00100000:2.0:1788625522.060083:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299392 00000100:00100000:2.0:1788625522.060143:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788625522.060153:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+19:22796:x1875509206299392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625522.060167:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625522.060181:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bfb4 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.060213:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 20 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.060225:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 20 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.060234:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:2.0:1788625522.060285:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:22796:x1875509206299392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625522.060293:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788625522.060340:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625522.060356:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625522.060366:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625522.060419:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788625522.060453:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625522.060488:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788625522.060696:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299520 00000100:00100000:2.0:1788625522.060701:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299520 00000100:00100000:2.0:1788625522.060778:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788625522.060787:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:22796:x1875509206299520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788625522.060803:0:22793:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788625522.060819:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788625522.060823:0:22793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788625522.060915:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:22796:x1875509206299520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625522.060928:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788625522.060998:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625522.061084:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625522.061092:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625522.061100:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625522.061109:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625522.061112:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998872de2800 from 13 10000000:01000000:0.0:1788625522.061124:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625522.061143:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625522.061151:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625522.061170:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625522.061184:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625522.061212:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625522.066420:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299648 00000100:00100000:3.0:1788625522.066436:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299648 00000100:00100000:2.0:1788625522.067356:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788625522.067374:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:22796:x1875509206299648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625522.067394:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625522.067412:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bfc2 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.067441:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.067452:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625522.067461:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:2.0:1788625522.067548:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206299648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (6335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625522.067872:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788625522.067899:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625522.067919:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625522.067931:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625522.068009:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788625522.068064:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625522.068080:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788625522.069264:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299776 00000100:00100000:1.0:1788625522.069274:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299776 00000100:00100000:1.0:1788625522.069311:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788625522.069320:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206299776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625522.069356:0:22794:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625522.069371:0:22794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625522.069373:0:22794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788625522.069677:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206299776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 357us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625522.069687:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788625522.069792:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a87b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206299776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625522.069858:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625522.069868:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625522.069879:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625522.070901:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788625522.763748:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625523.212203:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788625523.788625:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625524.811675:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788625525.517282:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625525.517291:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625525.517294:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625525.517298:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625525.517315:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625525.517318:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788625525.517321:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788625525.517324:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625525.517371:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206300032:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625525.517488:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206300544:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517513:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625525.517562:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788625525.517568:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206300160:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517591:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625525.517619:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517641:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625525.517681:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300032 00000100:00100000:1.0:1788625525.517689:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300032 00000100:00100000:1.0:1788625525.517735:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625525.517744:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517798:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206300032:12345-0@lo:400:kworker.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625525.517805:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625525.517830:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300544 00000100:00100000:1.0:1788625525.517834:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300544 00000100:00100000:1.0:1788625525.517865:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300160 00000100:00100000:1.0:1788625525.517868:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300160 00000100:00100000:1.0:1788625525.517880:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300672 00000100:00100000:1.0:1788625525.517883:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300672 00000100:00100000:1.0:1788625525.517898:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625525.517904:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206300544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517935:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206300544:12345-0@lo:400:kworker.0 Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625525.517941:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788625525.517951:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625525.517956:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.517981:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206300160:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625525.517999:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625525.518112:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206300288:0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625525.518173:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788625525.518179:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206299904:0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518205:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625525.518227:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206300416:0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625525.518268:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300288 00000100:00100000:0.0:1788625525.518271:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300288 00000100:00100000:0.0:1788625525.518296:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625525.518303:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206300288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518338:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206300288:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625525.518344:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788625525.518362:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206299904 00000100:00100000:0.0:1788625525.518365:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206299904 00000100:00100000:0.0:1788625525.518389:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625525.518396:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3637:x1875509206299904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518421:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3637:x1875509206299904:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625525.518427:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788625525.518469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206299904:0@lo:400:kworker.0 00000100:00100000:0.0:1788625525.518481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.518562:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300416 00000100:00100000:1.0:1788625525.518566:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300416 00000100:00100000:1.0:1788625525.518580:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625525.518592:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206300672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.518620:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206300672:12345-0@lo:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625525.518625:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625525.518635:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625525.518639:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206300416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.518662:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206300416:12345-0@lo:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625525.518667:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788625525.518706:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788625525.518711:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788625525.518732:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987439f4000 x1875509206300160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625525.518742:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206300160:0@lo:400:kworker.0 00010000:00080000:1.0:1788625525.518752:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987439f7b80 x1875509206300672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625525.518759:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788625525.518769:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206300032:0@lo:400:kworker.0 00010000:00080000:1.0:1788625525.518777:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987439f4a80 x1875509206300544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625525.518785:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206300544:0@lo:400:kworker.0 00010000:00080000:0.0:1788625525.518876:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987439f5f80 x1875509206300416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625525.518885:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206300416:0@lo:400:kworker.0 00000001:02000400:3.0:1788625525.708722:0:24669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788625525.836717:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625526.511247:0:24721:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625526.512326:0:24721:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788625526.859690:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625527.051880:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206300800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625527.052007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625527.052281:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300800 00000100:00100000:1.0:1788625527.052290:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300800 00000100:00100000:1.0:1788625527.052343:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788625527.052361:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206300800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788625527.052396:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788625527.052457:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206300800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625527.052464:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788625527.052644:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206300800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788625527.054734:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625527.054754:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206300928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625527.054847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625527.055589:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206300928 00000100:00100000:1.0:1788625527.055597:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206300928 00000100:00100000:1.0:1788625527.055644:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625527.055654:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206300928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625527.055686:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788625527.055754:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206300928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625527.055762:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788625527.055810:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206300928:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788625527.112078:0:24771:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625527.112273:0:24771:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788625527.883849:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625528.908778:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625528.972198:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788625529.932912:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625530.636916:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625530.637070:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.637184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625530.637257:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.637291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625530.637347:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301184 00000100:00100000:3.0:1788625530.637354:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301184 00000100:00100000:3.0:1788625530.637399:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625530.637408:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.637460:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206301184:12345-0@lo:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.637468:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788625530.637511:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206301184:0@lo:400:kworker.0 00000100:00080000:2.0:1788625530.637780:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625530.637785:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625530.637788:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625530.637791:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625530.637856:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206301312:0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.637931:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625530.638082:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206301440:0@lo:400:kworker.0 00000100:00100000:1.0:1788625530.638117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625530.638179:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301312 00000100:00100000:3.0:1788625530.638184:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301312 00000100:00100000:3.0:1788625530.638219:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625530.638225:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206301312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.638264:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206301312:12345-0@lo:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.638271:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625530.638289:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301440 00000100:00100000:3.0:1788625530.638298:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301440 00000100:00100000:3.0:1788625530.638319:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625530.638324:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206301440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.638356:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206301440:12345-0@lo:400:kworker.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.638362:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788625530.638386:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206301440:0@lo:400:kworker.0 00010000:00080000:3.0:1788625530.638412:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99884435ad80 x1875509206301312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625530.638423:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206301312:0@lo:400:kworker.0 00000100:00080000:2.0:1788625530.639095:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625530.639100:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788625530.639103:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625530.639106:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788625530.639156:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206301568:0@lo:400:kworker.0 00000100:00100000:1.0:1788625530.639192:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625530.639253:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301568 00000100:00100000:3.0:1788625530.639258:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301568 00000100:00100000:3.0:1788625530.639287:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625530.639294:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206301568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.639432:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206301568:12345-0@lo:400:kworker.0 Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.639439:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625530.639548:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301056 00000100:00100000:2.0:1788625530.639552:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301056 00000100:00100000:2.0:1788625530.639581:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788625530.639589:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3636:x1875509206301056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625530.639622:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3636:x1875509206301056:12345-0@lo:400:kworker.0 Request processed in 35us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625530.639628:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788625530.639735:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206301824:0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.639766:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625530.639792:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301824 00000100:00100000:3.0:1788625530.639795:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301824 00000100:00100000:3.0:1788625530.639826:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625530.639832:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206301824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.639861:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206301824:12345-0@lo:400:kworker.0 Request processed in 30us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.639867:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788625530.639902:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788625530.639928:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998844358000 x1875509206301824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625530.639941:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206301824:0@lo:400:kworker.0 00010000:00080000:1.0:1788625530.640069:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998844359880 x1875509206301568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625530.640078:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206301696:0@lo:400:kworker.0 00000100:00100000:1.0:1788625530.640085:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206301568:0@lo:400:kworker.0 00000100:00100000:2.0:1788625530.640122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625530.640193:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.640238:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301696 00000100:00100000:3.0:1788625530.640242:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301696 00000100:00100000:3.0:1788625530.640309:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625530.640316:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625530.640353:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206301696:12345-0@lo:400:kworker.0 Request processed in 38us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625530.640360:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788625530.640403:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788625530.640425:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99884435a300 x1875509206301696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625530.640436:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206301696:0@lo:400:kworker.0 00010000:00010000:2.0:1788625530.955780:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625531.660607:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625516/real 1788625516] req@ffff998743832680 x1875509206295040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625531 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.660661:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743832680 x1875509206295040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625531 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.660671:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625516/real 1788625516] req@ffff998743833100 x1875509206295168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625531 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.660684:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743833100 x1875509206295168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625531 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788625531.660713:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625531.660742:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625531.660748:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206295040:0@lo:8:kworker.0 00000100:00080000:3.0:1788625531.660756:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625531.660778:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788625531.660803:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206295168:0@lo:8:kworker.0 00000100:00080000:0.0:1788625531.660873:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.660879:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625531.660883:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.660886:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625531.660908:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.660912:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788625531.660916:0:38:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625531.660923:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 637 00000100:00100000:3.0:1788625531.661006:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206302080:0@lo:400:kworker.0 00000100:00080000:0.0:1788625531.661076:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788625531.661086:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99887ca92800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625531.661113:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998872d0e680 x1875509206302464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625531.661130:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.661134:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788625531.661137:0:38:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788625531.661140:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1788625531.661143:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788625531.661147:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887ca90800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625531.661160:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998872d0ce00 x1875509206302592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788625531.661207:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.661210:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788625531.661213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788625531.661216:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788625531.661233:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206301952:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.661291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.661343:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206302720:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.661377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.661405:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625531.661411:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206302336:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.661439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.661473:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206302208:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.661501:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.661574:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206302976:0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.662741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625531.662808:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206302848:0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.662881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625531.662933:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302720 00000100:00100000:3.0:1788625531.662944:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302720 00000100:00100000:3.0:1788625531.663004:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302208 00000100:00100000:3.0:1788625531.663008:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302208 00000100:00100000:3.0:1788625531.663022:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302848 00000100:00100000:3.0:1788625531.663024:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302848 00000100:00100000:3.0:1788625531.663042:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625531.663052:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206302720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.663139:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206302720:12345-0@lo:400:kworker.0 Request processed in 88us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.663148:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788625531.663172:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625531.663181:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206302208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.663199:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625531.666399:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206302208:12345-0@lo:400:kworker.0 Request processed in 3192us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.666426:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788625531.666493:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302976 00000100:00100000:3.0:1788625531.666509:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302976 00010000:00080000:0.0:1788625531.667235:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c380 x1875509206302208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.667264:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206302208:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.667333:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206301952 00000100:00100000:0.0:1788625531.667340:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206301952 00000100:00100000:3.0:1788625531.667566:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625531.667579:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206302848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.667755:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206302848:12345-0@lo:400:kworker.0 Request processed in 177us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.667791:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625531.667815:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625531.667822:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206302976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.667885:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206302976:12345-0@lo:400:kworker.0 Request processed in 64us (4688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.667892:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788625531.667921:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302336 00000100:00100000:3.0:1788625531.667937:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302336 00000100:00100000:3.0:1788625531.667970:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302080 00000100:00100000:3.0:1788625531.667974:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302080 00000100:00100000:3.0:1788625531.668001:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625531.668008:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206302336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.668056:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206302336:12345-0@lo:400:kworker.0 Request processed in 49us (6617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.668063:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788625531.668076:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788625531.668083:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206302080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.668114:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206302080:12345-0@lo:400:kworker.0 Request processed in 32us (5378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.668121:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788625531.668179:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0fb80 x1875509206302848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.668194:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206302848:0@lo:400:kworker.0 00000100:00100000:3.0:1788625531.668210:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206302080:0@lo:400:kworker.0 00010000:00080000:3.0:1788625531.668264:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0d500 x1875509206302976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.668282:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206302976:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.670582:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625531.670625:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3638:x1875509206301952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.670767:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3638:x1875509206301952:12345-0@lo:400:kworker.0 Request processed in 160us (9476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625531.670777:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788625531.673414:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206302336:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.673436:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998848a84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206301952:0@lo:400:kworker.0 00010000:00080000:0.0:1788625531.673456:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0f480 x1875509206302720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.673469:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206302720:0@lo:400:kworker.0 00000100:00100000:0.0:1788625531.673558:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206302464:0@lo:8:kworker.0 00000100:00100000:0.0:1788625531.673684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.673766:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206302592:0@lo:8:kworker.0 00000100:00100000:0.0:1788625531.673801:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625531.673981:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302464 00000100:00100000:2.0:1788625531.674000:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302464 00000100:00100000:2.0:1788625531.674039:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206302592 00000100:00100000:2.0:1788625531.674041:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206302592 00000100:00100000:2.0:1788625531.674057:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625531.674069:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206302464:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625531.674149:0:24305:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:2.0:1788625531.674205:0:24305:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7bfd0 00002000:00100000:2.0:1788625531.674232:0:24305:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff998741f14800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788625531.674238:0:24305:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788625531.674242:0:24305:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625531.674552:0:24305:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788625531.674591:0:24305:0:(import.c:65:import_set_state_nolock()) ffff998741f15800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625531.674672:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206302464:12345-0@lo:8:kworker.0 Request processed in 604us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625531.674681:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788625531.674707:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625531.674712:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206302592:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788625531.674729:0:24305:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788625531.680907:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0e680 x1875509206302464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625531.680931:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788625531.680948:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788625531.680961:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788625531.680970:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788625531.680975:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca92800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788625531.681466:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788625531.681479:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206302464:0@lo:8:kworker.0 00000004:00080000:1.0:1788625531.684817:0:23539:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788625531.685002:0:23539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 652792484235ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788625531.685014:0:23539:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788625531.687250:0:23540:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788625531.687295:0:23540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303232:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788625531.687391:0:23540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.687433:0:23540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625531.687475:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788625531.687484:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788625531.687835:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625531.687883:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206303104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625531.690258:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625531.690495:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303232 00000100:00100000:1.0:1788625531.690510:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303232 00000100:00100000:0.0:1788625531.691137:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303104 00000100:00100000:0.0:1788625531.691145:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303104 00000100:00100000:0.0:1788625531.691193:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788625531.691205:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875509206303104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625531.691250:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625531.691365:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875509206303104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625531.691393:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788625531.691455:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c380 x1875509206303104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.691481:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206303104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625531.692363:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788625531.692375:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23540:x1875509206303232:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1788625531.693673:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788625531.693752:0:23531:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788625531.699690:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875509206302592:12345-0@lo:8:kworker.0 Request processed in 24969us (25881us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788625531.699706:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788625531.700466:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788625531.700474:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788625531.700478:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206302592:0@lo:8:kworker.0 00002000:00080000:2.0:1788625531.702298:0:25084:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788625531.702307:0:25084:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788625531.702400:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23540:x1875509206303232:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10025us (15006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625531.702411:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788625531.702488:0:23540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c000 x1875509206303232/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625547 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.702509:0:23540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303232:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788625531.702556:0:23540:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788625531.702737:0:23540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303360:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788625531.702799:0:23540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.702846:0:23540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625531.702878:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303360 00000100:00100000:2.0:1788625531.702889:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303360 00000100:00100000:2.0:1788625531.702946:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625531.702956:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23540:x1875509206303360:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788625531.702985:0:24307:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788625531.703047:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23540:x1875509206303360:12345-0@lo:5:osp-pre-0-1.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625531.703054:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788625531.703226:0:23540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c000 x1875509206303360/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625547 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.703239:0:23540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303360:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788625531.703250:0:23540:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788625531.703281:0:23540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303488:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788625531.703311:0:23540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625531.703338:0:23540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625531.703367:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303488 00000100:00100000:2.0:1788625531.703374:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303488 00000100:00100000:2.0:1788625531.703410:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788625531.703418:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23540:x1875509206303488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788625531.703445:0:24305:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1788625531.730064:0:24301:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788625531.730081:0:24301:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788625531.730383:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23540:x1875509206303488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 26953us (27058us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788625531.730399:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788625531.730838:0:23540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c000 x1875509206303488/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625531.730853:0:23540:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788625531.730870:0:23540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23540:1875509206303488:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788625531.730887:0:23540:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788625531.730948:0:23540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23540:1875509206303616:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788625531.731059:0:23540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625531.731095:0:23540:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625531.731296:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303616 00000100:00100000:3.0:1788625531.731304:0:22811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303616 00000100:00100000:3.0:1788625531.731354:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788625531.731364:0:22811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23540:x1875509206303616:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788625531.731435:0:22811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23540:x1875509206303616:12345-0@lo:900:osp-pre-0-1.0 Request processed in 72us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625531.731442:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788625531.731552:0:23540:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9987439f6d80 x1875509206303616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625531.731659:0:23540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23540:1875509206303616:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788625531.979960:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625532.173972:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625532.174004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206303744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625532.174098:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.174160:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303744 00000100:00100000:2.0:1788625532.174169:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303744 00000100:00100000:2.0:1788625532.174231:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625532.174242:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206303744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788625532.174287:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788625532.174340:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206303744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.174349:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625532.174426:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206303744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625532.177025:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625532.177051:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206303872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625532.177134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.177191:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206303872 00000100:00100000:0.0:1788625532.177199:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206303872 00000100:00100000:0.0:1788625532.177275:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625532.177287:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206303872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625532.177341:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625532.177393:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206303872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.177401:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788625532.177451:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206303872:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1788625532.301834:0:25117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788625532.301837:0:25117:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788625532.301839:0:25117:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788625532.301972:0:25117:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998742687000 00000020:01000004:1.0:1788625532.301987:0:25117:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788625532.302003:0:25117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788625532.302018:0:25117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99887b48b380) 00000020:00000080:1.0:1788625532.302045:0:25117:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788625532.372690:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788625532.376027:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788625532.376876:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788625532.377193:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788625532.377405:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788625532.377706:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788625532.377984:0:25117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788625532.379571:0:25117:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788625532.380448:0:25117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788625532.380465:0:25117:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788625532.380479:0:25117:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7bfde 00000020:01000004:2.0:1788625532.380485:0:25117:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788625532.380509:0:25117:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788625532.380513:0:25117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788625532.380556:0:25117:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788625532.380586:0:25117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788625532.380590:0:25117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788625532.398022:0:25117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788625532.398062:0:25117:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.114@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788625532.398067:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788625532.398069:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625532.398070:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625532.398071:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625532.398072:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625532.398073:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625532.398075:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625532.398077:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625532.398078:0:25117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625532.398082:0:25117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788625532.398084:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788625532.398085:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625532.398086:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625532.398091:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625532.398092:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625532.398093:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625532.398094:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625532.398095:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625532.398096:0:25117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788625532.398124:0:25117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788625532.398144:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788625532.398218:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.398268:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa000 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.398334:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304000 00000100:00100000:2.0:1788625532.398341:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304000 00000100:00100000:2.0:1788625532.398403:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788625532.398412:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:25117:x1875509206304000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788625532.398451:0:22794:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788625532.398454:0:22794:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788625532.398458:0:22794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788625532.398999:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:25117:x1875509206304000:12345-0@lo:253:mount.lustre.0 Request processed in 587us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.399007:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788625532.399091:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788625532.399101:0:25117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788625532.399104:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788625532.399105:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788625532.399106:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788625532.399107:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788625532.399108:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788625532.399109:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788625532.399110:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788625532.399112:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788625532.399113:0:25117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788625532.399130:0:25117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998742687000 from lustre-OST0001 10000000:01000000:0.0:1788625532.399166:0:25117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788625532.399169:0:25117:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788625532.399179:0:25117:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998844238000 local copy 00010000:00010000:0.0:1788625532.399189:0:25117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625532.399270:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625532.399301:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.399334:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625532.399399:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304128 00000100:00100000:3.0:1788625532.399404:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304128 00000100:00100000:3.0:1788625532.399439:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788625532.399447:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:25117:x1875509206304128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625532.399701:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:25117:x1875509206304128:12345-0@lo:501:mount.lustre.0 Request processed in 254us (398us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788625532.399709:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788625532.399836:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788625532.399976:0:25117:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788625532.400000:0:25117:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788625532.400007:0:25117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.400016:0:25117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21c00/0x2d2e3b3f34a7bcf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bcff expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625532.400054:0:25117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998742687000 10000000:01000000:3.0:1788625532.400059:0:25117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788625532.400064:0:25117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788625532.400067:0:25117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788625532.400071:0:25117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788625532.400075:0:25117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788625532.400099:0:25117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.400108:0:25117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.400117:0:25117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625532.400142:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625532.400170:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.400250:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988738d4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625532.400293:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304256 00000100:00100000:1.0:1788625532.400298:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304256 00000100:00100000:1.0:1788625532.400370:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788625532.400378:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:25117:x1875509206304256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625532.400388:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625532.400401:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7bfe5 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.400435:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfe5 expref: 22 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.400446:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743540000/0x2d2e3b3f34a7bfec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfe5 expref: 22 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.400455:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743540000, rc 0) 00000100:00100000:1.0:1788625532.400499:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304256:12345-0@lo:101:mount.lustre.0 Request processed in 123us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625532.400505:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788625532.400605:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788625532.400626:0:25117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfec expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.400636:0:25117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7bfec expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788625532.401934:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788625532.402600:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788625532.405046:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788625532.405099:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788625532.405117:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788625532.405132:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788625532.405148:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788625532.405161:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788625532.405173:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788625532.405186:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788625532.405198:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788625532.405222:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788625532.405227:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788625532.405333:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625532.405404:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.405449:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887c898f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.405588:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304384 00000100:00100000:2.0:1788625532.405595:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304384 00000100:00100000:2.0:1788625532.405652:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788625532.405662:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625532.405822:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304384:12345-0@lo:501:mount.lustre.0 Request processed in 161us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.405830:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788625532.405896:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788625532.405938:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788625532.405988:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625532.406024:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.406085:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304512 00000100:00100000:0.0:1788625532.406096:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304512 00000100:00100000:0.0:1788625532.406121:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788625532.406128:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625532.406885:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304512:12345-0@lo:503:mount.lustre.0 Request processed in 756us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.406892:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788625532.407343:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788625532.407802:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625532.407897:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625532.408059:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625532.408095:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.408185:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304640 00000100:00100000:0.0:1788625532.408191:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304640 00000100:00100000:0.0:1788625532.408221:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788625532.408229:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.408701:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304640:12345-0@lo:502:mount.lustre.0 Request processed in 472us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.408709:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788625532.409048:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788625532.409246:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788625532.409278:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788625532.409291:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788625532.409304:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788625532.409317:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788625532.409342:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788625532.409356:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788625532.409370:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788625532.409384:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788625532.409412:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788625532.409457:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625532.409496:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff998743798cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.409726:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304768 00000100:00100000:0.0:1788625532.409732:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304768 00000100:00100000:0.0:1788625532.409808:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788625532.409816:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.409928:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304768:12345-0@lo:502:mount.lustre.0 Request processed in 112us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.409935:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788625532.410004:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788625532.410042:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788625532.410050:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788625532.411500:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788625532.411511:0:25121:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788625532.411553:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788625532.411556:0:25121:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788625532.411562:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788625532.411578:0:25121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99887cb1cd40) 00000020:00000080:2.0:1788625532.411604:0:25121:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788625532.411612:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788625532.411829:0:25121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998742687000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788625532.411838:0:25121:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788625532.411969:0:25121:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2d2e3b3f34a7bffa 00010000:00010000:3.0:1788625532.416973:0:25121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788625532.420683:0:25121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788625532.423340:0:25121:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788625532.424573:0:25121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788625532.424583:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625532.424590:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625532.424592:0:25121:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788625532.424596:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625532.424599:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625532.424601:0:25121:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788625532.424603:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788625532.424610:0:25121:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788625532.424613:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625532.424616:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625532.424617:0:25121:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788625532.424619:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788625532.424622:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625532.424623:0:25121:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788625532.424626:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788625532.424647:0:25121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788625532.424650:0:25121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788625532.424651:0:25121:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788625532.424654:0:25121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788625532.426626:0:25117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788625532.426670:0:25117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788625532.426699:0:25117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfec expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.426713:0:25117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682c00/0x2d2e3b3f34a7bfe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7bfec expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625532.426722:0:25117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998742687000 from 1 10000000:01000000:3.0:1788625532.426725:0:25117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788625532.426777:0:25117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.426786:0:25117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.426800:0:25117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625532.426826:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788625532.426905:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.426949:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da600 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.427403:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206304896 00000100:00100000:0.0:1788625532.427412:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206304896 00000100:00100000:0.0:1788625532.427497:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788625532.427508:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:25117:x1875509206304896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788625532.427543:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625532.427558:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c001 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.427582:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.427593:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.427602:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20800, rc 0) 00000100:00100000:0.0:1788625532.427645:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206304896:12345-0@lo:101:mount.lustre.0 Request processed in 138us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.427652:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788625532.429614:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206304896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788625532.429641:0:25117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625532.429654:0:25117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625532.433256:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788625532.433587:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625532.433832:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788625532.433868:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788625532.433884:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788625532.433895:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788625532.433907:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788625532.433921:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788625532.433935:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788625532.433948:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788625532.433962:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788625532.433975:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788625532.433986:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788625532.434002:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788625532.434007:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788625532.434078:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625532.434297:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.434344:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.434574:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305024 00000100:00100000:0.0:1788625532.434588:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305024 00000100:00100000:0.0:1788625532.434641:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788625532.434651:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625532.436628:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305024:12345-0@lo:501:mount.lustre.0 Request processed in 1966us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.436642:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788625532.437792:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625532.437865:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788625532.437943:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.437989:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.438264:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305152 00000100:00100000:0.0:1788625532.438272:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305152 00000100:00100000:0.0:1788625532.438327:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788625532.438335:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625532.438463:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305152:12345-0@lo:503:mount.lustre.0 Request processed in 127us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.438470:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788625532.438591:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788625532.439037:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788625532.439813:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625532.440063:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.440103:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.440157:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305280 00000100:00100000:0.0:1788625532.440164:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305280 00000100:00100000:0.0:1788625532.440220:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788625532.440228:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.440346:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305280:12345-0@lo:502:mount.lustre.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.440352:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788625532.440445:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625532.440706:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788625532.440735:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788625532.440748:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788625532.440759:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788625532.440784:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788625532.440801:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788625532.440825:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788625532.440839:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788625532.440864:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788625532.440880:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788625532.440903:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788625532.440934:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788625532.440974:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.441001:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da840 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.441126:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305408 00000100:00100000:2.0:1788625532.441132:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305408 00000100:00100000:2.0:1788625532.441171:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788625532.441179:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625532.441264:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305408:12345-0@lo:502:mount.lustre.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.441272:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788625532.441492:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788625532.441562:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788625532.441571:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788625532.442478:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625532.442487:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442489:0:25125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788625532.442496:0:25125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998742687000 00000020:00000080:3.0:1788625532.442498:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625532.442508:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625532.442510:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442511:0:25125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788625532.442513:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625532.442551:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442553:0:25125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788625532.442558:0:25125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998742687000 00000020:00000080:3.0:1788625532.442560:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625532.442619:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625532.442623:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442625:0:25125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788625532.442627:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625532.442630:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442631:0:25125:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625532.442634:0:25125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998742687000 00000020:00000080:3.0:1788625532.442645:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625532.442666:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625532.442669:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442670:0:25125:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788625532.442672:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788625532.442675:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442676:0:25125:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788625532.442679:0:25125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998742687000 00000020:00000080:3.0:1788625532.442681:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788625532.442699:0:25125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788625532.442702:0:25125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788625532.442703:0:25125:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788625532.442706:0:25125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788625532.444271:0:25117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788625532.444309:0:25117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788625532.444336:0:25117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.444349:0:25117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625532.444414:0:25117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788625532.444418:0:25117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998742687000 10000000:01000000:0.0:1788625532.444421:0:25117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998742687000 10000000:01000000:0.0:1788625532.444425:0:25117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788625532.444430:0:25117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998742687000 from 1 10000000:01000000:0.0:1788625532.444433:0:25117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788625532.444468:0:25117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.444476:0:25117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.444487:0:25117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625532.444510:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788625532.444627:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.444665:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99885eefa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788625532.445477:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305536 00000100:00100000:1.0:1788625532.445485:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305536 00000100:00100000:1.0:1788625532.445551:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625532.445561:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:25117:x1875509206305536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625532.445576:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625532.445591:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7c016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c00f expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.445629:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7c016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c00f expref: 24 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.445643:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743540400/0x2d2e3b3f34a7c016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c00f expref: 24 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.445653:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743540400, rc 0) 00000100:00100000:1.0:1788625532.445721:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305536:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625532.445729:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788625532.445785:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788625532.445800:0:25117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c016 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.445810:0:25117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c016 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788625532.453890:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788625532.454186:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788625532.454359:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788625532.454384:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788625532.454399:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788625532.454410:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788625532.454422:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788625532.454433:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788625532.454446:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788625532.454458:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788625532.454487:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788625532.454501:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788625532.454512:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788625532.454576:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788625532.454589:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788625532.454601:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788625532.454611:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788625532.454622:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788625532.454632:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788625532.454643:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788625532.454654:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788625532.454665:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788625532.454677:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788625532.454690:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788625532.454702:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788625532.457024:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788625532.457075:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788625532.457095:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788625532.457111:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788625532.457127:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788625532.457141:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788625532.457160:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788625532.457180:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788625532.457200:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788625532.457217:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788625532.457234:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788625532.457257:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788625532.457275:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788625532.457295:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788625532.457312:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788625532.457329:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788625532.457348:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788625532.457382:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788625532.457404:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788625532.457438:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788625532.457461:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788625532.457489:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788625532.457506:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788625532.457543:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788625532.457560:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788625532.457739:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788625532.457763:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788625532.457781:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788625532.457786:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788625532.457904:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788625532.457972:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.458015:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305664 00000100:00100000:2.0:1788625532.458021:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845258780 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.458025:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305664 00000100:00100000:0.0:1788625532.458080:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788625532.458089:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788625532.458231:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305664:12345-0@lo:501:mount.lustre.0 Request processed in 142us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.458238:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788625532.458882:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788625532.458937:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788625532.458986:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.459024:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437da840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.459676:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305792 00000100:00100000:0.0:1788625532.459684:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305792 00000100:00100000:0.0:1788625532.459721:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625532.459736:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305792:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788625532.459836:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305792:12345-0@lo:503:mount.lustre.0 Request processed in 101us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.459843:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788625532.460595:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788625532.461108:0:25117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788625532.461192:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.461234:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.461267:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.461279:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206305920 00000100:00100000:2.0:1788625532.461286:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206305920 00000100:00100000:2.0:1788625532.461324:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788625532.461333:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625532.461514:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206305920:12345-0@lo:502:mount.lustre.0 Request processed in 181us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.461540:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788625532.462287:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206305920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625532.462622:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788625532.462650:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788625532.462661:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788625532.462668:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788625532.462675:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788625532.462684:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788625532.462692:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788625532.462700:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788625532.462711:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788625532.462723:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788625532.463038:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788625532.463052:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788625532.463063:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788625532.463078:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788625532.463106:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788625532.463123:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788625532.463147:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788625532.463161:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788625532.463189:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788625532.463208:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788625532.463224:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788625532.463238:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788625532.463253:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788625532.463267:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788625532.463277:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788625532.463285:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788625532.463293:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788625532.463301:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788625532.463309:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788625532.463318:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788625532.463327:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788625532.463337:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788625532.463356:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788625532.463367:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788625532.463381:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788625532.463395:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788625532.463410:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788625532.463424:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788625532.463438:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788625532.463451:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788625532.463463:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788625532.463479:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788625532.463494:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788625532.463541:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788625532.463559:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788625532.463572:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788625532.463586:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788625532.463613:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788625532.463658:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206306048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.463707:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.463745:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715540 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.464267:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306048 00000100:00100000:2.0:1788625532.464274:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306048 00000100:00100000:2.0:1788625532.464326:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788625532.464335:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206306048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788625532.464468:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206306048:12345-0@lo:502:mount.lustre.0 Request processed in 134us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.464476:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788625532.465592:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206306048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625532.465806:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788625532.465834:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788625532.465880:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206306176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.465932:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.465965:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715540 going to sleep for 11 seconds 00000100:00100000:0.0:1788625532.466400:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306176 00000100:00100000:0.0:1788625532.466406:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306176 00000100:00100000:0.0:1788625532.466453:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788625532.466462:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206306176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788625532.466623:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206306176:12345-0@lo:502:mount.lustre.0 Request processed in 161us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625532.466631:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788625532.466685:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206306176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788625532.466744:0:25117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788625532.466754:0:25117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788625532.469072:0:25130:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788625532.469090:0:25130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99887cb1b380) 00000020:00000080:2.0:1788625532.469115:0:25130:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788625532.469226:0:25130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998742687000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788625532.469231:0:25130:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998742687000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788625532.469234:0:25130:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998742687000 3 00010000:00080000:2.0:1788625532.469271:0:25130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99874400f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.114@tcp at head 00010000:00010000:2.0:1788625532.476060:0:25130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788625532.476307:0:25130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788625532.476373:0:25130:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788625532.476398:0:25130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2d2e3b3f34a7c024 00000100:00080000:2.0:1788625532.476409:0:25130:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788625532.476416:0:25130:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99874400f800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625532.476452:0:25130:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844359180 x1875509206306304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625532.476484:0:25130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788625532.476826:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206306304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625532.476910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788625532.476974:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625532.476980:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625532.476982:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625532.476986:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625532.477034:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625532.477038:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788625532.477041:0:15724:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788625532.477041:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788625532.477049:0:15724:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00100000:1.0:1788625532.477056:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206306560:0@lo:400:kworker.0 00000100:00080000:3.0:1788625532.477064:0:15724:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788625532.477071:0:15724:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887ca90800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:3.0:1788625532.477089:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743833b80 x1875509206306688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788625532.477100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625532.477135:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206306816:0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477158:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306304 00000100:00100000:1.0:1788625532.477163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.477166:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306304 00000100:00100000:3.0:1788625532.477198:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306816 00000100:00100000:1.0:1788625532.477201:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306560 00000100:00100000:3.0:1788625532.477202:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306816 00000100:00100000:1.0:1788625532.477207:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306560 00000100:00100000:2.0:1788625532.477231:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206306688:0@lo:8:kworker.0 00000100:00100000:3.0:1788625532.477242:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625532.477251:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788625532.477256:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206306816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625532.477265:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206306560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625532.477273:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.477322:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206306816:12345-0@lo:400:kworker.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.477329:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788625532.477344:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625532.477348:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875509206306304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625532.477368:0:24101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:3.0:1788625532.477400:0:24101:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7c02b 00000004:00100000:3.0:1788625532.477413:0:24101:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625532.477439:0:24101:0:(import.c:65:import_set_state_nolock()) ffff998743526800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625532.477480:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875509206306304:12345-0@lo:38:llog_process_th.0 Request processed in 130us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.477487:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788625532.477504:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206306432:0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477563:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788625532.477573:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998844359180 x1875509206306304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625532.477584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206307072:0@lo:400:kworker.0 00000100:00100000:2.0:1788625532.477585:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625532.477597:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788625532.477606:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788625532.477611:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788625532.477614:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99874400f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788625532.477619:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.477625:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875509206306304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788625532.477647:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625532.477656:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206306944:0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.477707:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306432 00000100:00100000:3.0:1788625532.477711:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306432 00000100:00100000:3.0:1788625532.477728:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307072 00000100:00100000:3.0:1788625532.477731:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307072 00000100:00080000:2.0:1788625532.477760:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625532.477769:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306944 00000100:00100000:3.0:1788625532.477773:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306944 00000100:00080000:2.0:1788625532.477790:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625532.477795:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625532.477802:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206306432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477858:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206306432:12345-0@lo:400:kworker.0 Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.477867:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788625532.477883:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625532.477892:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206307072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477926:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998848a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206307072:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.477932:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788625532.477945:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788625532.477951:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206306944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625532.477992:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206306944:12345-0@lo:400:kworker.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.477999:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788625532.478615:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998743832300 x1875509206306432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625532.478640:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206306432:0@lo:400:kworker.0 00010000:00080000:2.0:1788625532.478681:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998743830380 x1875509206307072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625532.478692:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206307072:0@lo:400:kworker.0 00000100:00100000:1.0:1788625532.478747:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206306560:12345-0@lo:400:kworker.0 Request processed in 1484us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625532.478758:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788625532.478777:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206306688 00000100:00100000:1.0:1788625532.478782:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206306688 00000100:00100000:1.0:1788625532.478814:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788625532.478820:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206306688:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788625532.478894:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875509206306688:12345-0@lo:8:kworker.0 Request processed in 73us (1622us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788625532.478909:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788625532.478951:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998743831180 x1875509206306816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625532.478962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206306816:0@lo:400:kworker.0 00010000:00080000:3.0:1788625532.478985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998743831f80 x1875509206306560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625532.478993:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206306560:0@lo:400:kworker.0 00000100:00100000:1.0:1788625532.479041:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788625532.479048:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788625532.479054:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788625532.479058:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206306688:0@lo:8:kworker.0 00010000:00080000:3.0:1788625532.481224:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998743831c00 x1875509206306944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625532.481243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206306944:0@lo:400:kworker.0 00000020:01000004:0.0:1788625532.482048:0:25130:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788625532.482070:0:25130:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99885ecd99c0) 00000020:00000080:0.0:1788625532.482094:0:25130:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788625532.482178:0:25130:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998742687000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788625532.482183:0:25130:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998742687000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788625532.482185:0:25130:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998742687000 3 00010000:00080000:0.0:1788625532.482212:0:25130:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99884f169800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.114@tcp at head 00010000:00010000:0.0:1788625532.484545:0:25130:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788625532.484753:0:25130:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788625532.485264:0:25130:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788625532.485285:0:25130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2d2e3b3f34a7c039 00000100:00080000:0.0:1788625532.485297:0:25130:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788625532.485304:0:25130:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99884f169800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:0.0:1788625532.485342:0:25130:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998872d0c700 x1875509206307200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625532.485400:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206307200:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788625532.485476:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788625532.485559:0:25130:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788625532.486376:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625532.486382:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788625532.486385:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788625532.486389:0:15724:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788625532.486414:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307200 00000100:00100000:3.0:1788625532.486422:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307200 00000100:00100000:3.0:1788625532.486460:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788625532.486468:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875509206307200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788625532.486498:0:22801:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:3.0:1788625532.486547:0:22801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2d2e3b3f34a7c040 00000004:00100000:3.0:1788625532.486565:0:22801:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788625532.486598:0:22801:0:(import.c:65:import_set_state_nolock()) ffff998743521800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788625532.486941:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875509206307200:12345-0@lo:38:llog_process_th.0 Request processed in 472us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.486949:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788625532.486966:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998872d0c700 x1875509206307200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788625542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625532.486977:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625532.486985:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788625532.486993:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788625532.486997:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788625532.486999:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99884f169800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788625532.487005:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875509206307200:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788625532.487991:0:25130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788625532.489004:0:25117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788625532.489046:0:25117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788625532.489339:0:25117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c016 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625532.489352:0:25117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21200/0x2d2e3b3f34a7c00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c016 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625532.489410:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788625532.489413:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625532.489420:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625532.489421:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625532.489423:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625532.489425:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625532.489426:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625532.489427:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625532.489429:0:25117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625532.489432:0:25117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788625532.489435:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788625532.489437:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788625532.489438:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625532.489440:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625532.489441:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625532.489442:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625532.489443:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625532.489445:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625532.489445:0:25117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788625532.489470:0:25117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788625532.489488:0:25117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206307328:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788625532.489823:0:25117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.489875:0:25117:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866fdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625532.489895:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307328 00000100:00100000:3.0:1788625532.489907:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307328 00000100:00100000:3.0:1788625532.489953:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788625532.489961:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206307328:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788625532.489986:0:22792:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788625532.489998:0:22792:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788625532.498423:0:22792:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788625532.498437:0:22792:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788625532.498508:0:22815:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788625532.498514:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788625532.498553:0:22815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.498572:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 24 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.498580:0:22815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.498587:0:22815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.498692:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.498706:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625532.498721:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206307456:0@lo:104: 00000100:00100000:1.0:1788625532.498862:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625532.498969:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307456 00000100:00100000:2.0:1788625532.498978:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307456 00010000:00010000:1.0:1788625532.499005:0:22815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 24 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.499027:0:22815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 24 pid: 22794 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625532.499033:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625532.499044:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206307584:0@lo:104: 00000100:00100000:2.0:1788625532.499048:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206307456:12345-0@lo:104: 00010000:00010000:2.0:1788625532.499064:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625532.499074:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625532.499120:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788625532.499127:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206307456:12345-0@lo:104: Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625532.499134:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625532.499159:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307584 00000100:00100000:2.0:1788625532.499163:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307584 00000100:00100000:1.0:1788625532.499167:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987437983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625532.499186:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625532.499193:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206307584:12345-0@lo:104: 00000100:00100000:1.0:1788625532.499195:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206307456:0@lo:104: 00010000:00010000:2.0:1788625532.499210:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625532.499251:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788625532.499258:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:22815:x1875509206307584:12345-0@lo:104: Request processed in 65us (186us total) trans 0 rc 0/0 00010000:00010000:0.0:1788625532.499261:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788625532.499263:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22815:1875509206307584:0@lo:104: 00000100:00100000:2.0:1788625532.499267:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788625532.499269:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.499281:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625532.499285:0:22788:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.499294:0:22788:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625532.499296:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625532.499298:0:22815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625532.499305:0:22788:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625532.499315:0:22788:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625532.499351:0:22788:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.499359:0:22788:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788625532.499392:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206307712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788625532.499417:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625532.499447:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:25117:x1875509206307328:12345-0@lo:253:mount.lustre.0 Request processed in 9487us (9624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.499456:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788625532.499484:0:25117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:25117:1875509206307328:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1788625532.499493:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625532.499495:0:25117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788625532.499498:0:25117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788625532.499500:0:25117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00010000:00010000:0.0:1788625532.499501:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7bfc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfc9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788625532.499502:0:25117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788625532.499503:0:25117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788625532.499504:0:25117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788625532.499506:0:25117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788625532.499507:0:25117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788625532.499509:0:25117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788625532.499510:0:25117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1788625532.499547:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625532.499550:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000000:2.0:1788625532.499554:0:25117:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788625532.499554:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625532.499561:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307712 00000100:00100000:1.0:1788625532.499566:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307712 00010000:00010000:1.0:1788625532.499590:0:22785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625532.499685:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625532.499696:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3637:x1875509206307712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625532.499709:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625532.499715:0:22785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.499728:0:22785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.499819:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7bfc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfc2 expref: 24 pid: 22793 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625532.499833:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625532.499950:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:3637:x1875509206307712:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625532.499957:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788625532.499994:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206307712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625532.500042:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625532.500045:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625532.500046:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625532.500157:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500166:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1788625532.500169:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500177:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788625532.500184:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625532.500189:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788625532.500217:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500222:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788625532.500236:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500243:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682a00/0x2d2e3b3f34a7bfb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bfbb expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625532.500254:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206307840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625532.500256:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625532.500258:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625532.500266:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625532.500283:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625532.500332:0:23551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307840 00000100:00100000:0.0:1788625532.500337:0:23551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307840 00010000:00010000:0.0:1788625532.500354:0:23551:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 23 pid: 22794 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625532.500409:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625532.500416:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:3638:x1875509206307840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625532.500425:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625532.500429:0:23551:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 23 pid: 22794 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500439:0:23551:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 23 pid: 22794 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500466:0:23551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7bfbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bfb4 expref: 23 pid: 22794 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500478:0:23551:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500487:0:23551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788625532.500500:0:23551:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004287958s 00010000:00010000:0.0:1788625532.500505:0:23551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500512:0:23551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500539:0:23551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500552:0:23551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500558:0:23551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743540600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625532.500562:0:23551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500571:0:23551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500586:0:23551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.500595:0:22815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625532.500596:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625532.500603:0:22815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625532.500609:0:22815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743540600/0x2d2e3b3f34a7c047 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625532.500643:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:3638:x1875509206307840:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625532.500651:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206307840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625532.500651:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:3.0:1788625532.502593:0:25117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788625532.506576:0:25117:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788625532.506598:0:25117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788625532.506638:0:25117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788625532.506811:0:25117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788625532.506861:0:25117:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788625532.506880:0:25117:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788625532.507787:0:25117:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625532.508033:0:25117:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788625533.005619:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788625533.333563:0:25184:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788625533.333780:0:25184:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788625533.453293:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788625534.032436:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788625534.349071:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625534.349079:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998874b51800 from 14 10000000:01000000:0.0:1788625534.349085:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625534.349134:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.349149:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.349162:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625534.349202:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206307968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625534.349274:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625534.349325:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998847f3b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625534.349344:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206307968 00000100:00100000:2.0:1788625534.349353:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206307968 00000100:00100000:2.0:1788625534.349407:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625534.349418:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206307968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625534.349431:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625534.349447:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4a00/0x2d2e3b3f34a7c055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c04e expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.349471:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4a00/0x2d2e3b3f34a7c055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c04e expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.349491:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4a00/0x2d2e3b3f34a7c055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c04e expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.349502:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4a00, rc 0) 00000100:00100000:2.0:1788625534.349561:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206307968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625534.349937:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788625534.350182:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206307968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625534.350199:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c055 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.350209:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c055 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625534.350267:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788625534.350316:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625534.350348:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887b715d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625534.350502:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308096 00000100:00100000:0.0:1788625534.350508:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308096 00000100:00100000:0.0:1788625534.350674:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788625534.350684:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206308096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788625534.350702:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788625534.350719:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788625534.350722:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788625534.350990:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206308096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625534.350999:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788625534.352583:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625534.353334:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625534.353349:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c055 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.353363:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da21e00/0x2d2e3b3f34a7c04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c055 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788625534.353379:0:22796:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788625534.353382:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998872de2800 from 14 10000000:01000000:0.0:1788625534.353386:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788625534.353434:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.353443:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.353462:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625534.353489:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788625534.353596:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625534.353645:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625534.353656:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308224 00000100:00100000:2.0:1788625534.353667:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308224 00000100:00100000:2.0:1788625534.353728:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788625534.353740:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206308224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625534.353757:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625534.353771:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7c063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c05c expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.353797:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7c063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c05c expref: 24 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.353833:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5200/0x2d2e3b3f34a7c063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c05c expref: 24 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625534.353843:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5200, rc 0) 00000100:00100000:2.0:1788625534.353891:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206308224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625534.353897:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788625534.356948:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625534.356978:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c063 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.356992:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c063 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625534.357077:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788625534.357336:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625534.357393:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625534.357548:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308352 00000100:00100000:1.0:1788625534.357555:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308352 00000100:00100000:1.0:1788625534.357607:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788625534.357616:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206308352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788625534.357635:0:22792:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788625534.357652:0:22792:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788625534.357655:0:22792:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788625534.357757:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206308352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625534.357766:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788625534.357900:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206308352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788625534.358025:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788625534.358033:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c063 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625534.358042:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff99887da20600/0x2d2e3b3f34a7c05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c063 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625535.051711:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.079227:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625536.587611:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625516/real 1788625516] req@ffff998743833480 x1875509206294656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625536.587661:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743833480 x1875509206294656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625536.587671:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788625516/real 1788625516] req@ffff998743831500 x1875509206294784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625536.587683:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998743831500 x1875509206294784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788625536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788625536.587702:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625536.587730:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625536.587734:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206294656:0@lo:8:kworker.0 00000100:00080000:0.0:1788625536.587740:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788625536.587745:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788625536.587748:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206294784:0@lo:8:kworker.0 00000100:00080000:2.0:1788625536.587898:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625536.587903:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788625536.587906:0:15724:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625536.587911:0:15724:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1788625536.587916:0:15724:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788625536.587923:0:15724:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9988582ec800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625536.587941:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99884435a300 x1875509206308736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625536.587954:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625536.587957:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788625536.587959:0:15724:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625536.587962:0:15724:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1788625536.587964:0:15724:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788625536.587967:0:15724:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9987438d1800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625536.587976:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998844359880 x1875509206308864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788625536.588008:0:15724:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788625536.588017:0:15724:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788625536.588019:0:15724:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788625536.588023:0:15724:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99887ca90800 using connection 192.168.204.114@tcp/0@lo 00000100:00100000:2.0:1788625536.588035:0:15724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998743831500 x1875509206309376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788625536.588082:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206308608:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588145:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588184:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206309504:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588212:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588231:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206310016:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588272:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788625536.588277:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206308480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588366:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206309888:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588385:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588410:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206308992:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588450:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206309632:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588470:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588489:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788625536.588495:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206309120:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206309760:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.588616:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308608 00000100:00100000:2.0:1788625536.588623:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308608 00000100:00100000:2.0:1788625536.588666:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309120 00000100:00100000:2.0:1788625536.588669:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309120 00000100:00100000:2.0:1788625536.588686:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625536.588694:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206308608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588743:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206308608:12345-0@lo:400:kworker.0 Request processed in 50us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.588751:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625536.588780:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625536.588786:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206309120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588817:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206309120:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.588822:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788625536.588841:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309504 00000100:00100000:2.0:1788625536.588845:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309504 00000100:00100000:2.0:1788625536.588860:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310016 00000100:00100000:2.0:1788625536.588863:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310016 00000100:00100000:2.0:1788625536.588885:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309888 00000100:00100000:2.0:1788625536.588888:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309888 00000100:00100000:2.0:1788625536.588901:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308992 00000100:00100000:2.0:1788625536.588903:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308992 00000100:00100000:2.0:1788625536.588914:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309632 00000100:00100000:2.0:1788625536.588916:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309632 00000100:00100000:2.0:1788625536.588925:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309760 00000100:00100000:2.0:1788625536.588928:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309760 00000100:00100000:2.0:1788625536.588951:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625536.588958:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206309504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.588987:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206309504:12345-0@lo:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.588993:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788625536.589015:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625536.589021:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206310016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589048:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206310016:12345-0@lo:400:kworker.0 Request processed in 28us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589054:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788625536.589063:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625536.589068:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206309888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589090:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875509206309888:12345-0@lo:400:kworker.0 Request processed in 22us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589095:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788625536.589105:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625536.589111:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206308992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589136:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875509206308992:12345-0@lo:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589142:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788625536.589153:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625536.589158:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589183:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206309632:12345-0@lo:400:kworker.0 Request processed in 25us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589189:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788625536.589208:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625536.589214:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206309760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589241:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206309760:12345-0@lo:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589247:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788625536.589270:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308480 00000100:00100000:2.0:1788625536.589274:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308480 00000100:00100000:2.0:1788625536.589301:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788625536.589307:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3636:x1875509206308480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589336:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3636:x1875509206308480:12345-0@lo:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589341:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788625536.589366:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309248 00000100:00100000:2.0:1788625536.589370:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309248 00000100:00100000:2.0:1788625536.589399:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788625536.589405:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206309248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589433:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206309248:12345-0@lo:400:kworker.0 Request processed in 29us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.589439:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788625536.589470:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625536.589474:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625536.589476:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625536.589509:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206309120:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.589541:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743830380 x1875509206309760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.589551:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206309760:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.589573:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844358000 x1875509206308992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.589581:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875509206308992:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.589590:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831c00 x1875509206309632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.589598:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206309632:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.589627:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206308736:0@lo:8:kworker.0 00000100:00100000:2.0:1788625536.589657:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.589676:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206308864:0@lo:8:kworker.0 00000100:00100000:2.0:1788625536.589715:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.589730:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206309376:0@lo:8:kworker.0 00000100:00100000:2.0:1788625536.589748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.589788:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308736 00000100:00100000:2.0:1788625536.589792:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308736 00000100:00100000:2.0:1788625536.589806:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206308864 00000100:00100000:2.0:1788625536.589808:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206308864 00000100:00100000:2.0:1788625536.589814:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206309376 00000100:00100000:2.0:1788625536.589816:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206309376 00000100:00100000:2.0:1788625536.589825:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625536.589829:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875509206308736:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625536.589853:0:24306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788625536.589877:0:24306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7c06a 00002000:00100000:2.0:1788625536.589891:0:24306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff998743916000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788625536.589895:0:24306:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788625536.589904:0:24306:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625536.589977:0:24306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625536.590001:0:24306:0:(import.c:65:import_set_state_nolock()) ffff998743913800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625536.590037:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206308736:12345-0@lo:8:kworker.0 Request processed in 206us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.590043:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625536.590055:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625536.590059:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875509206308864:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625536.590074:0:24306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788625536.590088:0:24306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2d2e3b3f34a7c071 00002000:00100000:2.0:1788625536.590094:0:24306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff998743917800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788625536.590098:0:24306:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788625536.590100:0:24306:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625536.590238:0:24306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625536.590252:0:24306:0:(import.c:65:import_set_state_nolock()) ffff998743913000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625536.590279:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875509206308864:12345-0@lo:8:kworker.0 Request processed in 218us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.590286:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788625536.590299:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625536.590303:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875509206309376:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788625536.590316:0:24306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788625536.590330:0:24306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2d2e3b3f34a7c078 00002000:00100000:2.0:1788625536.590336:0:24306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff998743910800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788625536.590340:0:24306:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788625536.590341:0:24306:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788625536.590362:0:24306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788625536.590379:0:24306:0:(import.c:65:import_set_state_nolock()) ffff998743916800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625536.590407:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875509206309376:12345-0@lo:8:kworker.0 Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.590413:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788625536.590445:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3636:1875509206308480:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.590456:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844358700 x1875509206309248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590466:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206309248:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.590476:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743833b80 x1875509206309888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590485:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875509206309888:0@lo:400:kworker.0 00000100:00100000:2.0:1788625536.590496:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206308608:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.590505:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743833480 x1875509206309504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590512:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206309504:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.590542:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831f80 x1875509206310016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590550:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206310016:0@lo:400:kworker.0 00010000:00080000:2.0:1788625536.590583:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99884435a300 x1875509206308736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590591:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625536.590597:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788625536.590604:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625536.590615:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788625536.590618:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9988582ec800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625536.590631:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625536.590635:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206308736:0@lo:8:kworker.0 00010000:00080000:2.0:1788625536.590649:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844359880 x1875509206308864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.590655:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788625536.590659:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788625536.590663:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000004:00080000:0.0:1788625536.591623:0:22823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788625536.591695:0:22823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 657699177436ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788625536.591704:0:22823:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788625536.591766:0:22824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788625536.591802:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22824:1875509206310272:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788625536.591846:0:22824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625536.591868:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64840 going to sleep for 11 seconds 00000100:00100000:0.0:1788625536.592016:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788625536.592028:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206310144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625536.592055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625536.592084:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310144 00000100:00100000:0.0:1788625536.592096:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310144 00000100:00100000:0.0:1788625536.592145:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788625536.592153:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206310144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788625536.592176:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625536.592216:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206310144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625536.592222:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788625536.592245:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788625536.592268:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998872d0c000 x1875509206310144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625536.592283:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206310144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625536.592307:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310272 00000100:00100000:0.0:1788625536.592310:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310272 00000100:00100000:0.0:1788625536.592333:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788625536.592340:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22824:x1875509206310272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788625536.597339:0:24306:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788625536.597351:0:24306:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1788625536.597358:0:24306:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00080000:2.0:1788625536.600643:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788625536.600653:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9987438d1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625536.600690:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625536.600701:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875509206308864:0@lo:8:kworker.0 00010000:00080000:2.0:1788625536.600745:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743831500 x1875509206309376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788625561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788625536.600765:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788625536.600785:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788625536.600789:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788625536.600791:0:3634:0:(import.c:65:import_set_state_nolock()) ffff99887ca90800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788625536.600804:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788625536.600808:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875509206309376:0@lo:8:kworker.0 00000004:00080000:2.0:1788625536.600860:0:23541:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788625536.600977:0:23541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 657708459049ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788625536.600988:0:23541:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788625536.601411:0:22826:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788625536.601434:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22826:1875509206310528:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788625536.601501:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.601551:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625536.601571:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310528 00000100:00100000:2.0:1788625536.601576:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310528 00000100:00100000:2.0:1788625536.601627:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788625536.601635:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22826:x1875509206310528:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788625536.601846:0:23542:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788625536.601863:0:23542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206310784:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788625536.601890:0:23542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.601906:0:23542:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987439a4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788625536.601919:0:24307:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625536.601926:0:24307:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788625536.602007:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788625536.602017:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206310656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625536.602041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625536.602077:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310784 00000100:00100000:2.0:1788625536.602080:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310784 00000100:00100000:2.0:1788625536.602175:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788625536.602183:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23542:x1875509206310784:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788625536.606289:0:22825:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788625536.606429:0:22825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 657713910744ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788625536.606438:0:22825:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788625536.606475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206310400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625536.606577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625536.607060:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310656 00000100:00100000:1.0:1788625536.607071:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310656 00000100:00100000:1.0:1788625536.607105:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310400 00000100:00100000:1.0:1788625536.607108:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310400 00000100:00100000:1.0:1788625536.607123:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625536.607132:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1875509206310656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625536.607165:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625536.607243:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1875509206310656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625536.607249:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788625536.607278:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788625536.607284:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206310400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625536.607294:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625536.607329:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875509206310400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625536.607335:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788625536.607372:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874407aa00 x1875509206310400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788625536.607390:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206310400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788625536.608147:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788625536.609035:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874407b100 x1875509206310656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788625552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625536.609060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206310656:0@lo:13:osp-pre-1-1.0 00002000:00080000:2.0:1788625536.612334:0:25084:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788625536.612350:0:25084:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788625536.612358:0:25084:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:3.0:1788625536.615180:0:23531:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788625536.616208:0:25380:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788625536.616216:0:25380:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788625536.616885:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23542:x1875509206310784:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14696us (14986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625536.616898:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:0.0:1788625536.619450:0:22779:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788625536.620924:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.620937:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.620954:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.620958:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.620964:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.620982:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.620993:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621000:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621026:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.621038:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.621044:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621052:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743540600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.621056:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621065:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621085:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621093:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cc2e6ce/0x2d2e3b3f34a7c07f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621115:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.621118:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.621120:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.621557:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.621564:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621574:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.621584:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.621589:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621600:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621609:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621616:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.621630:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.624851:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.624865:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.624879:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743540a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.624884:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.624910:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.624936:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.624944:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caafcd65/0x2d2e3b3f34a7c086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.624967:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.624969:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.624971:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788625536.625093:0:22779:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788625536.626293:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.626305:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626321:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.626326:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.626333:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626346:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626356:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626371:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626395:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.626408:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.626414:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626421:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743541800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.626425:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626434:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626448:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626455:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ba4c16/0x2d2e3b3f34a7c08d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.626472:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.626474:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.626476:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.629736:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.629759:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.629790:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.629795:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.629802:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.629817:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.629828:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788625536.629981:0:23542:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874407a680 x1875509206310784/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788625552 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625536.629996:0:23542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206310784:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788625536.630010:0:23542:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788625536.630052:0:23542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206310912:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788625536.630116:0:23542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625536.630149:0:23542:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00010000:00010000:1.0:1788625536.630997:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.631023:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788625536.632622:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.632633:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632648:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.632652:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.632658:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632671:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632686:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632694:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632716:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625536.632729:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625536.632736:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632744:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743541e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.632749:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632759:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632785:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632793:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e13ac165/0x2d2e3b3f34a7c094 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.632812:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.632822:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.633436:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.633484:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.633489:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.633498:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.633511:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625536.633579:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206310912 00000100:00100000:3.0:1788625536.633589:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206310912 00000100:00100000:3.0:1788625536.633642:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625536.633652:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23542:x1875509206310912:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788625536.633692:0:24307:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788625536.633788:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23542:x1875509206310912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 137us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625536.633795:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788625536.633849:0:23542:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844936300 x1875509206310912/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788625552 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625536.633864:0:23542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206310912:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788625536.633879:0:23542:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788625536.633921:0:23542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206311040:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788625536.633955:0:23542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625536.633979:0:23542:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00000100:00100000:3.0:1788625536.633993:0:25380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311040 00000100:00100000:3.0:1788625536.633996:0:25380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311040 00000100:00100000:3.0:1788625536.634018:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625536.634023:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23542:x1875509206311040:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788625536.634049:0:25380:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1788625536.636823:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c09b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.636870:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.636873:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.636876:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.643838:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.643853:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.643871:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.643876:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.643882:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.643901:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.643912:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.643920:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646280:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.646305:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.646314:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646329:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.646341:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646353:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646374:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646382:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c0a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646405:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.646407:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.646409:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.646664:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.646671:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646682:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.646687:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.646695:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646709:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646718:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646731:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646748:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.646757:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.646761:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646780:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.646784:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646792:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646803:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646810:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c0a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.646824:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.646825:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.646827:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.648552:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.648569:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.648584:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.648588:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.648593:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.648605:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.648615:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.648623:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.648638:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.648920:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.648928:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.648937:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.648941:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.648961:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.648978:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.648985:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c0b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649000:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.649002:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.649004:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.649183:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.649189:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649197:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.649200:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.649205:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649215:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649223:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649236:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649255:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.649427:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.649432:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.649439:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.649443:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.649451:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.649468:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.649475:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e114d9d/0x2d2e3b3f34a7c0b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.649489:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.649491:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.649493:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.649903:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.649910:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649919:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.649923:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.649927:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649936:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649944:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649951:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.649966:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.650230:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.650236:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.650245:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.650249:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.650257:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.650271:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.650278:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd2b0ac5/0x2d2e3b3f34a7c0be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.650303:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.650305:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.650307:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.650434:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.650442:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.650450:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.650453:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.650457:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.650468:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.650475:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.650489:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.650507:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.651148:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.651155:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651170:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.651174:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651182:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651194:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651202:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c0c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651219:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.651220:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.651222:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.651263:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.651269:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651277:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.651281:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.651285:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651295:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651309:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651315:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.651329:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625536.651490:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.651496:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.651505:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.651508:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.651512:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.651547:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.651555:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.651563:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.651581:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625536.651725:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625536.651730:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651739:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.651742:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651750:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651762:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651780:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c0cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651795:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.651799:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651805:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.651813:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651821:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651838:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651845:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c0d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.651859:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.651861:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.651863:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.655532:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.655633:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.655644:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655664:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.655669:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.655675:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655690:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655701:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655709:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655738:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.655750:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.655756:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655764:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.655778:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655788:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655805:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655812:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c0da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.655830:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.655832:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.655833:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.656480:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.656487:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.656498:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.656508:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.656513:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.656649:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.656659:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.656665:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.656686:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.657509:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.657536:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.657557:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.657561:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.657570:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.657588:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.657596:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c0e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.657616:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.657618:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.657620:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.658640:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.658650:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.658664:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.658668:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.658674:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.658686:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.658696:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.658710:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.658730:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788625536.658950:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.658956:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.658965:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.658969:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.658974:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.658984:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.658992:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.659006:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.659024:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788625536.659165:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625536.659172:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659179:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.659183:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659191:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659212:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659220:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c0e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659238:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.659241:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659248:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.659251:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659260:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659270:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659277:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c0ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.659288:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.659290:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.659297:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.659338:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.659852:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.659859:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.659869:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.659873:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.659877:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.659888:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.659896:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.659903:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.659924:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625536.660082:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.660088:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.660097:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.660100:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.660104:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.660113:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.660121:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.660128:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.660146:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625536.660272:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625536.660278:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660286:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.660290:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660298:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660310:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660317:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c0f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660331:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.660335:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660352:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.660355:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660363:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660375:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660382:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c0fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.660397:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.660398:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.660400:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.661077:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.661085:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.661412:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.661417:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.661423:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.661581:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.661783:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.661790:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.661799:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.661802:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.661806:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.661817:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.661840:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.661848:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.661865:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.662027:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.662037:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.662045:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.662064:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625536.663189:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625536.663198:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663210:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.663216:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663227:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663244:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663252:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009330d994/0x2d2e3b3f34a7c10b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663269:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.663273:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663280:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.663283:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663295:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663318:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.663327:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c104 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.663344:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.663344:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.663347:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.663350:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.664360:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.664370:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.664384:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.664389:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.664395:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.664408:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.664419:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.664438:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.664458:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.664707:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.664714:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.664723:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.664727:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.664736:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.664752:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.664760:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c112 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.664798:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.664800:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.664802:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.666249:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.666260:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666275:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.666279:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.666285:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666299:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666308:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666317:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666333:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.666343:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.666348:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666362:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.666366:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666375:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666389:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666397:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.666418:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.666420:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.666422:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.667550:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.667561:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.667573:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.667577:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.667583:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.667596:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.667606:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.667614:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.667636:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.668015:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.668022:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.668031:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.668036:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.668045:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.668060:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.668068:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c120 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.668094:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.668095:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.668097:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.668580:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.668588:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.668598:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.668601:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.668607:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.668617:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.668632:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.668640:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.668656:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.670970:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.670983:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671007:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.671012:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671024:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671042:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671049:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671067:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.671069:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.671071:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.671139:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.671146:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671157:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.671170:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.671177:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671189:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671204:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671212:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671232:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.671694:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.671700:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.671708:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.671711:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.671719:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.671730:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.671737:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c12e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.671752:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.671759:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.671761:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.671958:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.671963:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671972:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.671976:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.671980:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671989:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.671996:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.672003:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.672024:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.672280:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.672287:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672294:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.672297:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672304:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672315:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672322:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496d7482/0x2d2e3b3f34a7c135 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672335:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.672336:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.672338:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.672387:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.672392:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672411:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.672414:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.672419:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672430:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672438:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672445:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672461:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.672469:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.672473:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672480:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.672483:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672490:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672512:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672537:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c13c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.672550:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.672552:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.672554:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.674992:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.675009:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675029:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.675034:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.675040:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675054:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675064:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625536.675070:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.675072:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675083:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675095:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.675099:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.675100:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.675106:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675118:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.675120:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675127:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675132:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675141:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.675146:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675156:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675168:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675194:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675196:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.675208:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c143 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675214:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.675223:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.675227:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.675230:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.675235:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.675235:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.675243:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675252:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675266:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675274:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c14a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.675392:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.675394:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.675397:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.677605:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.677620:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677637:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.677648:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.677656:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677671:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677682:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677690:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677709:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.677722:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.677728:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677735:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.677740:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677750:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677780:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677797:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005fe5d3/0x2d2e3b3f34a7c151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.677815:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.677817:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.677819:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.678223:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.678229:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678237:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.678241:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.678246:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678256:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678264:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678270:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678284:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625536.678533:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625536.678540:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.678549:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625536.678552:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788625536.678557:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788625536.678560:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678568:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678575:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.678578:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625536.678579:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678583:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.678587:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002424c0fb/0x2d2e3b3f34a7c158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678592:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678600:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.678602:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.678604:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.678606:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.678608:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678622:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.678629:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.678634:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678641:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.678645:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678652:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678670:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678678:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4248b99/0x2d2e3b3f34a7c15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.678692:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.678694:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.678696:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.679031:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.679038:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679047:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.679051:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.679056:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679065:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679073:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679080:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679102:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.679110:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.679114:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679120:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.679123:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679131:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679143:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679150:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e6a50a6/0x2d2e3b3f34a7c166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679161:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.679163:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.679165:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.679409:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.679415:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679424:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.679433:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.679437:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679446:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679454:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679461:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.679476:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625536.679698:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625536.679703:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.679711:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625536.679714:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.679723:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.679733:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.679739:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a237116/0x2d2e3b3f34a7c16d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.679775:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.679778:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.679779:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.680103:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.680109:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.680119:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.680122:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.680127:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.680139:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.680148:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.680162:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.680181:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.680418:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.680424:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680431:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.680435:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680443:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680456:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680475:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095527403/0x2d2e3b3f34a7c174 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680491:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.680492:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.680494:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.680534:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.680540:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680547:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.680550:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.680554:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680563:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680569:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680577:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680590:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.680597:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.680606:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680613:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.680616:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680623:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680636:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680642:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000696059fc/0x2d2e3b3f34a7c17b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.680655:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.680657:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.680658:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.681020:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.681026:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.681034:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.681037:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.681040:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.681050:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.681058:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.681065:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.681077:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788625536.681320:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.681326:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681334:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.681337:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.681340:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681359:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681369:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681375:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681388:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788625536.681397:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788625536.681400:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681407:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.681411:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681419:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681430:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681438:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e293a/0x2d2e3b3f34a7c182 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681458:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.681462:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681469:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.681472:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681481:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681490:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681497:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea93df2/0x2d2e3b3f34a7c189 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.681508:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.681510:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.681512:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.682060:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.682068:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682085:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.682089:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.682094:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682105:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682114:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682122:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682144:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.682394:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.682401:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682410:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.682419:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682428:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682442:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682449:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009330d994/0x2d2e3b3f34a7c190 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682463:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.682465:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.682467:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.682513:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.682534:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682542:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.682545:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.682549:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682558:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682565:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682578:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682592:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.682600:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.682603:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682610:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.682613:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682620:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682630:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682637:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e833f0/0x2d2e3b3f34a7c197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.682650:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.682652:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.682653:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.682868:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.682873:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682882:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.682885:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.682890:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682899:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682917:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682923:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.682941:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.683881:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.683896:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.683907:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5000 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.683911:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.683920:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.683935:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.683942:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b86a66e/0x2d2e3b3f34a7c19e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.683959:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.683960:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.683962:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.685613:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.685626:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.685642:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.685647:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.685653:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.685668:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.685678:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.685687:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.685726:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625536.685920:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625536.685929:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.685939:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625536.685944:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.685954:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.685974:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.685982:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c1a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.686001:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.686003:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.686005:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.686054:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.686107:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.686114:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686123:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.686127:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.686135:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686160:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686169:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686177:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686192:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788625536.686503:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.686508:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.686547:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.686552:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.686556:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.686566:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.686574:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.686581:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.686594:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788625536.686701:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.686706:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686721:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.686725:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.686728:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686737:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686745:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686761:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.686891:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788625536.687117:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788625536.687123:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687131:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.687141:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687150:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687165:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687172:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ebdfdf3/0x2d2e3b3f34a7c1ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687189:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625536.687193:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687200:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.687203:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687211:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687221:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687228:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006c635f0/0x2d2e3b3f34a7c1b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687246:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.687250:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687256:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.687259:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687267:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687277:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687285:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d1378b4/0x2d2e3b3f34a7c1ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687298:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.687300:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.687302:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.687381:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.687388:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687397:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.687401:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.687406:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687415:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687424:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687430:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687481:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.687739:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.687744:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687751:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40400 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.687760:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687782:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687794:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687800:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002462c556/0x2d2e3b3f34a7c1c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.687814:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.687815:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.687817:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.687932:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.687938:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.687952:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.688238:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.688245:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.688257:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.688266:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.688273:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.688323:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.688582:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.688588:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.688595:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.688599:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.688608:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.688621:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.688636:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017248afc/0x2d2e3b3f34a7c1c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.688651:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.688653:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.688654:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.688972:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.688980:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.688989:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.688992:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.688998:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.689008:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.689026:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.689034:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.689057:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788625536.689553:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625536.689562:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.689585:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625536.689589:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.689598:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.689612:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.689619:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ba73593/0x2d2e3b3f34a7c1cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625536.689639:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.689641:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.689643:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.690409:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788625536.690875:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788625536.690885:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.690899:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788625536.690904:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788625536.690911:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.690924:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.690933:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.690942:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.690978:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788625536.691088:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788625536.691094:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.691101:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625536.691105:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.691114:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625536.691443:0:25118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788625536.691475:0:25118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788625536.691483:0:25118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788625536.691653:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.691662:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1293c1/0x2d2e3b3f34a7c1d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625536.691683:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.691684:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788625536.691686:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.691946:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788625536.691951:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788625536.691957:0:24306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.691967:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1788625536.691970:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625536.691976:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.691985:0:24306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.691993:0:24306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.691999:0:24306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.692021:0:24306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625536.692231:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.692238:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692247:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.692249:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.692253:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692263:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692272:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692279:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692295:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788625536.692314:0:24306:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788625536.692341:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23542:x1875509206311040:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58311us (58379us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788625536.692354:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788625536.692366:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22824:x1875509206310272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100025us (100518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.692376:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625536.692418:0:23542:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788625536.692424:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22824:1875509206310272:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788625536.692427:0:23542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23542:1875509206311040:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788625536.692443:0:22824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000004:00080000:3.0:1788625536.692444:0:23542:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00010000:00010000:0.0:1788625536.692449:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788625536.692456:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692463:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.692466:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692481:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692494:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692502:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6865df6/0x2d2e3b3f34a7c1dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625536.692504:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874407b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22824:1875509206311168:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788625536.692538:0:23542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23542:1875509206311296:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788625536.692554:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.692560:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692567:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.692570:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625536.692580:0:23542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625536.692580:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692593:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692601:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d438cb2e/0x2d2e3b3f34a7c1e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625536.692618:0:23542:0:(client.c:2716:ptlrpc_set_wait()) set ffff998851c99840 going to sleep for 11 seconds 00010000:00010000:0.0:1788625536.692634:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.692638:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.692640:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625536.692642:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311296 00000100:00100000:3.0:1788625536.692650:0:22811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311296 00000100:00100000:3.0:1788625536.692705:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1788625536.692706:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.692713:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625536.692719:0:22811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23542:x1875509206311296:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788625536.692729:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=657s v=(0 0) 00000100:00100000:2.0:1788625536.692730:0:22824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788625536.692733:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.692737:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692747:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625536.692751:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff998866c64840 going to sleep for 11 seconds 00010000:00010000:0.0:1788625536.692755:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692763:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625536.692777:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311168 00000100:00100000:2.0:1788625536.692781:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311168 00010000:00010000:0.0:1788625536.692794:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788625536.692806:0:22811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23542:x1875509206311296:12345-0@lo:900:osp-pre-1-1.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625536.692811:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788625536.692823:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625536.692824:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22824:x1875509206311168:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1788625536.692854:0:23542:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844936300 x1875509206311296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788625552 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625536.692865:0:23542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844936300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23542:1875509206311296:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788625536.692878:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.692884:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692903:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.692908:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692917:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692929:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692937:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d46bc6c5/0x2d2e3b3f34a7c1eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.692970:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.692971:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.692973:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788625536.692999:0:24307:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:0.0:1788625536.693010:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.693015:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693023:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.693026:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.693030:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693039:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693052:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693060:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693072:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.693150:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.693154:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693161:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.693165:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693174:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693184:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693191:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0850c89/0x2d2e3b3f34a7c1f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693203:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.693209:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.693211:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.693720:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.693727:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693736:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.693739:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.693745:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693755:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693775:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693783:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693795:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.693894:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.693899:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693906:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.693909:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693928:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693940:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693948:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a1b88c/0x2d2e3b3f34a7c1f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.693961:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.693963:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.693965:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625536.693996:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.694147:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.694153:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.694161:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.694165:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.694169:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.694178:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.694186:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.694199:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.694212:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.695462:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.695472:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.695484:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171200 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.695488:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.695499:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.695789:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.695799:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a633c27d/0x2d2e3b3f34a7c200 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.695821:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.695824:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.695826:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.696067:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.696081:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696093:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.696097:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.696103:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696117:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696129:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696136:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696155:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788625536.696319:0:22788:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788625536.696325:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696333:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625536.696336:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696344:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696363:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696370:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4e099c/0x2d2e3b3f34a7c207 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.696388:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.696390:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788625536.696391:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.697652:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.697667:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.697685:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.697689:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.697696:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.697711:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.697720:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.697729:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.697776:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788625536.697961:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.697970:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.697979:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882170a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.697984:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.697994:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.698017:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.698026:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046faa85/0x2d2e3b3f34a7c20e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.698045:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.698047:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.698049:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788625536.698414:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.698422:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.698431:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.698434:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.698440:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.698449:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.698458:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.698467:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.698664:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625536.699384:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.699393:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.699405:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.699415:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.699422:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.699436:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.699446:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.699454:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788625536.700079:0:24301:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1788625536.700151:0:24301:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788625536.700236:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625536.700247:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700260:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998882171a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.700266:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700280:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700305:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700313:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000290d483a/0x2d2e3b3f34a7c215 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700348:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.700352:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700359:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668800 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.700363:0:25134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700373:0:25134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700384:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.700392:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.700394:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.700396:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625536.700718:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22824:x1875509206311168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7893us (7983us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788625536.700732:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788625536.701282:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788625536.701294:0:25084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ee92e0/0x2d2e3b3f34a7c21c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788625536.701996:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.702007:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702023:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.702028:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.702034:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702049:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702066:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702075:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702096:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788625536.702395:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.702402:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702411:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.702414:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.702419:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702430:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702437:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702444:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.702481:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788625536.702581:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625536.702590:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702599:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.702610:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702620:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702638:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702646:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b536920/0x2d2e3b3f34a7c223 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702661:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.702665:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702671:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742669a00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.702673:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702679:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702688:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702694:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffa5e908/0x2d2e3b3f34a7c22a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.702712:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.702714:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.702716:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625536.702912:0:22824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788625536.702926:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874407b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22824:1875509206311168:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788625536.702948:0:22824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:0.0:1788625536.703010:0:25084:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788625536.703016:0:25084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.703025:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1788625536.703028:0:25084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625536.703032:0:25084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.703042:0:25084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.703050:0:25084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.703057:0:25084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625536.703069:0:25084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788625536.703100:0:25084:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788625536.703220:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22826:x1875509206310528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 101584us (101717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625536.703232:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788625536.703288:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22826:1875509206310528:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788625536.703306:0:22826:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1788625536.703371:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22826:1875509206311424:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788625536.703420:0:22826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788625536.703456:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788625536.703461:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.703470:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742669e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:2.0:1788625536.703474:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.703483:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.703496:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.703505:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa55cff2/0x2d2e3b3f34a7c231 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625536.703541:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.703543:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625536.703545:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625536.703613:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff998845343900 going to sleep for 11 seconds 00000100:00100000:1.0:1788625536.703620:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311424 00010000:00010000:0.0:1788625536.703624:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625536.703630:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311424 00010000:00010000:0.0:1788625536.703630:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625536.703700:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788625536.703711:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22826:x1875509206311424:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788625536.703780:0:25084:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788625536.708580:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22826:x1875509206311424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4858us (5147us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788625536.708597:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625536.708730:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22826:1875509206311424:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788625536.708755:0:22826:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1788625536.781425:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206311552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625536.781496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625536.781814:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311552 00000100:00100000:0.0:1788625536.781823:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311552 00000100:00100000:0.0:1788625536.781872:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625536.781881:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206311552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625536.781902:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625536.781945:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206311552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625536.781951:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625536.781991:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206311552:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788625537.100069:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625537.295227:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625537.295251:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206311680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625537.295340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625537.295488:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311680 00000100:00100000:2.0:1788625537.295498:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311680 00000100:00100000:2.0:1788625537.295574:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625537.295584:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206311680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788625537.295622:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788625537.295677:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206311680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625537.295684:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788625537.295734:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625537.295741:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206311808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625537.295750:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206311680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625537.295894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625537.297194:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311808 00000100:00100000:1.0:1788625537.297205:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311808 00000100:00100000:1.0:1788625537.297256:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788625537.297275:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206311808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625537.297305:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788625537.297373:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874407b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206311808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625537.297381:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788625537.297507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206311808:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788625537.891494:0:25475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788625538.124240:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625538.188293:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788625538.950708:0:25527:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788625538.950932:0:25527:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788625539.147698:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788625539.752077:0:25577:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788625539.752308:0:25577:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788625540.045934:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.046075:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234560 00000100:00100000:0.0:1788625540.046088:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234560 00000100:00100000:0.0:1788625540.046180:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:0.0:1788625540.046192:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2390:x1875509185234560:12345-192.168.204.14@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788625540.046228:0:22794:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 532c19fa-8f42-4ef8-bbda-4aa0713b1686@192.168.204.14@tcp t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:0.0:1788625540.046284:0:22794:0:(genops.c:1385:class_connect()) connect: client 532c19fa-8f42-4ef8-bbda-4aa0713b1686, cookie 0x2d2e3b3f34a7c238 00000100:00080000:0.0:1788625540.046498:0:22794:0:(import.c:65:import_set_state_nolock()) ffff99884f16b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625540.046646:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+5:2390:x1875509185234560:12345-192.168.204.14@tcp:250:mount.lustre.0 Request processed in 454us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625540.046655:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 112 00000100:00100000:1.0:1788625540.059216:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.059346:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234688 00000100:00100000:2.0:1788625540.059361:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234688 00000100:00100000:2.0:1788625540.059498:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:2.0:1788625540.059550:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+5:18138:x1875509185234688:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625540.059573:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625540.059601:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7c23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e648 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.059641:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7c23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e648 expref: 6 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.059656:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5a00/0x2d2e3b3f34a7c23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e648 expref: 6 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.059692:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5a00, rc 0) 00000100:00100000:2.0:1788625540.059800:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+6:18138:x1875509185234688:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 291us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.059808:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 113 00000100:00100000:1.0:1788625540.063020:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.063137:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234816 00000100:00100000:0.0:1788625540.063151:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234816 00000100:00100000:0.0:1788625540.063231:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:0.0:1788625540.063241:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+6:18138:x1875509185234816:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788625540.063435:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+6:18138:x1875509185234816:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 194us (428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788625540.063445:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 114 00000100:00100000:0.0:1788625540.072491:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.072718:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185234944 00000100:00100000:1.0:1788625540.072733:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185234944 00000100:00100000:1.0:1788625540.073506:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:1.0:1788625540.073727:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+6:18138:x1875509185234944:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625540.073754:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625540.073988:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743b40000/0x2d2e3b3f34a7c246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e64f expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625540.074032:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b40000/0x2d2e3b3f34a7c246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e64f expref: 7 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625540.074066:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743b40000/0x2d2e3b3f34a7c246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e64f expref: 7 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625540.074078:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40000, rc 0) 00000100:00100000:1.0:1788625540.074166:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+7:18138:x1875509185234944:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 648us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.074174:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 115 00000100:00100000:1.0:1788625540.082131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.082401:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235072 00000100:00100000:2.0:1788625540.082415:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235072 00000100:00100000:2.0:1788625540.082492:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:2.0:1788625540.082503:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+7:18138:x1875509185235072:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788625540.082845:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18138:x1875509185235072:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 342us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.082854:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 116 00000100:00100000:0.0:1788625540.090030:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.090944:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235200 00000100:00100000:1.0:1788625540.090959:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235200 00000100:00100000:1.0:1788625540.091044:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 117 00000100:00100000:1.0:1788625540.091057:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18138:x1875509185235200:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788625540.091280:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18138:x1875509185235200:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 216us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.091289:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 117 00000100:00100000:3.0:1788625540.096745:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.097116:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235328 00000100:00100000:0.0:1788625540.097129:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235328 00000100:00100000:0.0:1788625540.097208:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:0.0:1788625540.097220:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235328:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788625540.097558:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235328:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 339us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625540.097568:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 118 00000100:00100000:0.0:1788625540.127152:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625540.127257:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235456 00000100:00100000:3.0:1788625540.127283:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235456 00000100:00100000:3.0:1788625540.127359:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:3.0:1788625540.127372:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235456:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625540.127657:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235456:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 286us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.127667:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 119 00000100:00100000:2.0:1788625540.136990:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.138917:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235584 00000100:00100000:1.0:1788625540.138936:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235584 00000100:00100000:1.0:1788625540.139108:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:1.0:1788625540.139121:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235584:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625540.139362:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18156:x1875509185235584:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 243us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.139372:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 120 00000100:00100000:1.0:1788625540.144684:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.144892:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235712 00000100:00100000:0.0:1788625540.144906:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235712 00000100:00100000:0.0:1788625540.144982:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:0.0:1788625540.144995:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+8:18138:x1875509185235712:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788625540.145018:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625540.145060:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998742669200/0x2d2e3b3f34a7c24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e680 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625540.145110:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998742669200/0x2d2e3b3f34a7c24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e680 expref: 9 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625540.145125:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998742669200/0x2d2e3b3f34a7c24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e680 expref: 9 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625540.145137:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998742669200, rc 0) 00000100:00100000:0.0:1788625540.145210:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+9:18138:x1875509185235712:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 218us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625540.145217:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 121 00000100:00100000:0.0:1788625540.149660:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.149794:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235840 00000100:00100000:1.0:1788625540.149827:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235840 00000100:00100000:1.0:1788625540.149903:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:1.0:1788625540.149914:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+9:18138:x1875509185235840:12345-192.168.204.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788625540.149949:0:22793:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788625540.149972:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788625540.149977:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788625540.149981:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788625540.149985:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788625540.149987:0:22793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788625540.152775:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+9:18138:x1875509185235840:12345-192.168.204.14@tcp:256:mount.lustre.0 Request processed in 2839us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.152792:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 122 00000100:00100000:3.0:1788625540.156470:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.156923:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185235968 00000100:00100000:2.0:1788625540.156936:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185235968 00000100:00100000:2.0:1788625540.157005:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 123 00000100:00100000:2.0:1788625540.157017:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988461c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+9:18138:x1875509185235968:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625540.157042:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625540.157065:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e687 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.157366:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 10 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.157384:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 10 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.157494:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5000, rc 0) 00000100:00100000:2.0:1788625540.157756:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988461c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18138:x1875509185235968:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 739us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.157772:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 123 00000100:00100000:0.0:1788625540.160695:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.160872:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236096 00000100:00100000:1.0:1788625540.160884:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236096 00000100:00100000:1.0:1788625540.161041:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:1.0:1788625540.161053:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18138:x1875509185236096:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788625540.161726:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18138:x1875509185236096:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 673us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.161737:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 124 00000100:00100000:3.0:1788625540.168211:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.168375:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236224 00000100:00100000:2.0:1788625540.168618:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236224 00000100:00100000:2.0:1788625540.168899:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 125 00000100:00100000:2.0:1788625540.168913:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18138:x1875509185236224:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788625540.169142:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18138:x1875509185236224:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 231us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.169151:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 125 00010000:00010000:3.0:1788625540.172547:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625540.172890:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.174056:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236352 00000100:00100000:1.0:1788625540.174072:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236352 00000100:00100000:1.0:1788625540.174150:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:1.0:1788625540.174161:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18159:x1875509185236352:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625540.174610:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18159:x1875509185236352:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 449us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.174619:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 126 00000100:00100000:0.0:1788625540.183077:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625540.192002:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236480 00000100:00100000:1.0:1788625540.192024:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236480 00000100:00100000:1.0:1788625540.192191:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:1.0:1788625540.192205:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18159:x1875509185236480:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625540.192839:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887cbe4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18159:x1875509185236480:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 558us (9696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.192850:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 127 00000100:00100000:0.0:1788625540.211888:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.211936:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625540.212498:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236608 00000100:00100000:3.0:1788625540.212514:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236608 00000100:00100000:3.0:1788625540.212613:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236864 00000100:00100000:3.0:1788625540.212616:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236864 00000100:00100000:3.0:1788625540.212647:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625540.212658:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875509185236608:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788625540.212709:0:24101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1788625540.212797:0:24101:0:(genops.c:1385:class_connect()) connect: client ca0f9b0c-1e13-4da9-865b-75626250b5f8, cookie 0x2d2e3b3f34a7c25b 00000004:00100000:3.0:1788625540.212831:0:24101:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788625540.213614:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:0.0:1788625540.213623:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1875509185236864:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788625540.213651:0:22801:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:0.0:1788625540.213711:0:22801:0:(genops.c:1385:class_connect()) connect: client ca0f9b0c-1e13-4da9-865b-75626250b5f8, cookie 0x2d2e3b3f34a7c262 00000004:00100000:0.0:1788625540.213729:0:22801:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788625540.213929:0:22801:0:(import.c:65:import_set_state_nolock()) ffff99884f168800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788625540.214034:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2390:x1875509185236864:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 409us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625540.214069:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00080000:2.0:1788625540.222280:0:24101:0:(import.c:65:import_set_state_nolock()) ffff99887e31d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625540.222430:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2390:x1875509185236608:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 9766us (10552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.222445:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:0.0:1788625540.229254:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.229305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.229343:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625540.229568:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236992 00000100:00100000:3.0:1788625540.229584:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236992 00000100:00100000:3.0:1788625540.229655:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185236736 00000100:00100000:3.0:1788625540.229659:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185236736 00000100:00100000:3.0:1788625540.229676:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237120 00000100:00100000:3.0:1788625540.229679:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237120 00000100:00100000:3.0:1788625540.229695:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625540.229718:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:0:x1875509185236992:12345-192.168.204.14@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788625540.229836:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625540.229841:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1788625540.229883:0:22801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625540.230005:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:0:x1875509185236992:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 289us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.230014:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:3.0:1788625540.230062:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625540.230068:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:0:x1875509185236736:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625540.230087:0:22801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788625540.230590:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:0:x1875509185236736:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 519us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.230598:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625540.230614:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:3.0:1788625540.230621:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237120:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625540.230635:0:22801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788625540.230660:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237120:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 40us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.230667:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:0.0:1788625540.233629:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625540.234214:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237248 00000100:00100000:3.0:1788625540.234229:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237248 00000100:00100000:2.0:1788625540.234476:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:2.0:1788625540.234490:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237248:12345-192.168.204.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788625540.234646:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237248:12345-192.168.204.14@tcp:40:mount.lustre.0 Request processed in 158us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.234654:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625540.237642:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.237972:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237376 00000100:00100000:2.0:1788625540.237984:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237376 00000100:00100000:2.0:1788625540.238047:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:2.0:1788625540.238057:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875509185237376:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625540.238237:0:24305:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:2.0:1788625540.238285:0:24305:0:(genops.c:1385:class_connect()) connect: client ca0f9b0c-1e13-4da9-865b-75626250b5f8, cookie 0x2d2e3b3f34a7c269 00002000:00100000:2.0:1788625540.238304:0:24305:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ca0f9b0c-1e13-4da9-865b-75626250b5f8/ffff9988771d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625540.238329:0:24305:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788625540.239639:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.239709:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00002000:00080000:2.0:1788625540.239913:0:24305:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625540.239961:0:24305:0:(import.c:65:import_set_state_nolock()) ffff9988771d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625540.240050:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2390:x1875509185237376:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 1992us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.240061:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625540.240134:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237632 00000100:00100000:3.0:1788625540.240143:0:22811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237632 00000100:00100000:3.0:1788625540.240198:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:3.0:1788625540.240208:0:22811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237632:12345-192.168.204.14@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788625540.240254:0:22811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237632:12345-192.168.204.14@tcp:900:mount.lustre.0 Request processed in 48us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.240261:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:2.0:1788625540.241709:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237504 00000100:00100000:2.0:1788625540.241728:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237504 00000100:00100000:1.0:1788625540.246580:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625540.246601:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2390:x1875509185237504:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788625540.246657:0:24306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:1.0:1788625540.246710:0:24306:0:(genops.c:1385:class_connect()) connect: client ca0f9b0c-1e13-4da9-865b-75626250b5f8, cookie 0x2d2e3b3f34a7c270 00002000:00100000:1.0:1788625540.246729:0:24306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ca0f9b0c-1e13-4da9-865b-75626250b5f8/ffff998741ddc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788625540.246755:0:24306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788625540.246980:0:24306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788625540.247204:0:24306:0:(import.c:65:import_set_state_nolock()) ffff998741ddf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625540.247350:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2390:x1875509185237504:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 745us (7642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625540.247361:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:3.0:1788625540.254909:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625540.255143:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237760 00000100:00100000:0.0:1788625540.255159:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237760 00000100:00100000:0.0:1788625540.255235:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625540.255248:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237760:12345-192.168.204.14@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788625540.260044:0:22802:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4644us 00000004:00200000:3.0:1788625540.272732:0:22802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788625540.272869:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18138:x1875509185237760:12345-192.168.204.14@tcp:33:mount.lustre.0 Request processed in 17617us (17971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625540.272897:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:0.0:1788625540.520566:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625540.520708:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185237888 00000100:00100000:2.0:1788625540.520718:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185237888 00000100:00100000:2.0:1788625540.520779:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:2.0:1788625540.520789:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18182:x1875509185237888:12345-192.168.204.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788625540.520810:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625540.520837:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7c277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e6b8 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.520902:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.521347:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.521364:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625540.521434:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788625540.521438:0:24101:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625540.521475:0:24101:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.521991:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5400/0x2d2e3b3f34a7c277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6b8 expref: 8 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.522012:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6b8 expref: 7 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625540.523136:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:2.0:1788625540.523140:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788625540.523144:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:2.0:1788625540.523285:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18182:x1875509185237888:12345-192.168.204.14@tcp:101:mkdir.0 Request processed in 2495us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625540.523294:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00010000:00010000:0.0:1788625541.201967:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625541.899890:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206312064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625541.899979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206312192:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206312704:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900132:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900148:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206313216:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900192:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788625541.900197:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206312320:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900218:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900242:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206312832:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900281:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206313344:0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.900301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.900309:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625541.900338:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206312576:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900355:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312192 00000100:00100000:2.0:1788625541.900363:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312192 00000100:00100000:2.0:1788625541.900405:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312704 00000100:00100000:2.0:1788625541.900409:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312704 00000100:00100000:3.0:1788625541.900431:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625541.900443:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788625541.900448:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625541.900449:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206312192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900459:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206312704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.900478:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206313088:0@lo:400:kworker.0 00000100:00100000:1.0:1788625541.900492:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206311936:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900544:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206312704:12345-0@lo:400:kworker.0 Request processed in 89us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.900548:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206312192:12345-0@lo:400:kworker.0 Request processed in 105us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.900556:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788625541.900563:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788625541.900583:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313216 00000100:00100000:2.0:1788625541.900587:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313216 00000100:00100000:3.0:1788625541.900594:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313344 00000100:00100000:3.0:1788625541.900599:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313344 00000100:00100000:2.0:1788625541.900626:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312576 00000100:00100000:3.0:1788625541.900631:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788625541.900633:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312576 00000100:00100000:3.0:1788625541.900640:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206313216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900657:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625541.900677:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206313344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625541.900687:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625541.900700:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875509206313216:12345-0@lo:400:kworker.0 Request processed in 60us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.900709:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788625541.900735:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625541.900736:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875509206313344:12345-0@lo:400:kworker.0 Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625541.900740:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206312448:0@lo:400:kworker.0 00000100:00100000:3.0:1788625541.900748:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900749:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788625541.900797:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206313728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625541.900814:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206312576:12345-0@lo:400:kworker.0 Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.900822:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788625541.900838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625541.900868:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206311936 00000100:00100000:3.0:1788625541.900873:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206311936 00010000:00080000:2.0:1788625541.900875:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844358700 x1875509206313344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625541.900890:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875509206313344:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900910:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206312192:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900923:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206312704:0@lo:400:kworker.0 00000100:00100000:3.0:1788625541.900924:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788625541.900937:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3635:x1875509206311936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900941:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875509206313216:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.900968:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625541.900977:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206313856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788625541.900978:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3635:x1875509206311936:12345-0@lo:400:kworker.0 Request processed in 43us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.900989:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788625541.901011:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.901048:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312064 00000100:00100000:2.0:1788625541.901052:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312064 00000100:00100000:2.0:1788625541.901074:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313728 00000100:00100000:2.0:1788625541.901077:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313728 00000100:00100000:1.0:1788625541.901085:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625541.901093:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.901097:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313856 00000100:00100000:2.0:1788625541.901101:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313856 00000100:00100000:1.0:1788625541.901120:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206312960:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901121:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625541.901130:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206313600:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901132:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206312064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625541.901154:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788625541.901162:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625541.901170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625541.901191:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206313472:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901204:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206312064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.901212:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788625541.901225:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788625541.901232:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206313728:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625541.901235:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312320 00000100:00100000:1.0:1788625541.901240:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312320 00002000:00000024:2.0:1788625541.901250:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625541.901280:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312832 00000100:00100000:1.0:1788625541.901284:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312832 00000100:00100000:0.0:1788625541.901290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206312064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788625541.901296:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206313728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625541.901301:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312448 00000100:00100000:2.0:1788625541.901306:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788625541.901307:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312448 00000100:00100000:0.0:1788625541.901323:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206312576:0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901330:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625541.901335:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206312960 00000100:00100000:0.0:1788625541.901336:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625541.901340:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206312960 00000100:00100000:0.0:1788625541.901346:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206313984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625541.901350:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206313856:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625541.901362:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00002000:00000024:2.0:1788625541.901363:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788625541.901373:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901395:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875509206313856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.901402:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788625541.901422:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206312320:12345-0@lo:400:kworker.0 Request processed in 51us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625541.901430:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788625541.901441:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206313856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625541.901451:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788625541.901456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625541.901462:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206313728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788625541.901463:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.901486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206312320:0@lo:400:kworker.0 00000100:00100000:1.0:1788625541.901510:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206312832:12345-0@lo:400:kworker.0 Request processed in 51us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.901542:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206312832:0@lo:400:kworker.0 00000100:00080000:2.0:1788625541.901577:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625541.901582:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625541.901585:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788625541.901588:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625541.901598:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313984 00000100:00100000:2.0:1788625541.901602:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313984 00000100:00100000:3.0:1788625541.901693:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313088 00000100:00100000:3.0:1788625541.901698:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313088 00000100:00100000:3.0:1788625541.901721:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313600 00000100:00100000:3.0:1788625541.901724:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313600 00000100:00100000:3.0:1788625541.901742:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625541.901747:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206313088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625541.901782:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875509206313088:12345-0@lo:400:kworker.0 Request processed in 35us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.901788:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788625541.901800:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788625541.901806:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206313600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625541.901832:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875509206313600:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625541.901838:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788625541.901857:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625541.901864:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788625541.901873:0:24308:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788625541.901875:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206313984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625541.901882:0:24308:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788625541.901889:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788625541.901921:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875509206313984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.901927:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625541.910313:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625541.910353:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.910455:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875509206312448:12345-0@lo:400:kworker.0 Request processed in 124us (9371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625541.916796:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788625541.918978:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625541.919036:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788625541.919298:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206313984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625541.919323:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875509206313088:0@lo:400:kworker.0 00010000:00080000:0.0:1788625541.919341:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998844358000 x1875509206313600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625541.919353:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875509206313600:0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.919447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625541.919509:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206311936:0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.919546:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.920148:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206313472 00000100:00100000:0.0:1788625541.920156:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206313472 00000100:00100000:0.0:1788625541.920207:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625541.920216:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206313472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625541.920295:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875509206313472:12345-0@lo:400:kworker.0 Request processed in 81us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625541.920310:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788625541.920348:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875509206313472:0@lo:400:kworker.0 00000100:00080000:0.0:1788625541.920372:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625541.927981:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206312960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625541.928096:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206312960:12345-0@lo:400:kworker.0 Request processed in 140us (26942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625541.928120:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788625541.928159:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206312960:0@lo:400:kworker.0 00010000:00010000:0.0:1788625542.219983:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625542.412283:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206314112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625542.412361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625542.413148:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625542.413161:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206314240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625542.413228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625542.413315:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314112 00000100:00100000:0.0:1788625542.413325:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314112 00000100:00100000:0.0:1788625542.413376:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314240 00000100:00100000:0.0:1788625542.413379:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314240 00000100:00100000:0.0:1788625542.413396:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625542.413404:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206314112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625542.413439:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788625542.413488:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206314112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625542.413496:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625542.413513:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625542.413551:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206314240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625542.413569:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625542.413599:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206314240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625542.413605:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625542.413643:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206314112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625542.413842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987442d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206314240:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788625542.935728:0:25118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca0f9b0c-1e13-4da9-865b-75626250b5f8 00000001:00080000:2.0:1788625542.935749:0:25118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00100000:2.0:1788625542.944766:0:24301:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca0f9b0c-1e13-4da9-865b-75626250b5f8 00000100:00100000:0.0:1788625543.023733:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.023986:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238016 00000100:00100000:3.0:1788625543.023999:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238016 00000100:00100000:3.0:1788625543.024084:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:3.0:1788625543.024095:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18235:x1875509185238016:12345-192.168.204.14@tcp:41:lfs.0 00000004:00000024:3.0:1788625543.024137:0:22801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788625543.024247:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18235:x1875509185238016:12345-192.168.204.14@tcp:41:lfs.0 Request processed in 153us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.024255:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00080000:0.0:1788625543.028444:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625543.028931:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.029047:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238144 00000100:00100000:3.0:1788625543.029058:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238144 00000100:00100000:3.0:1788625543.029185:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:3.0:1788625543.029212:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18235:x1875509185238144:12345-192.168.204.14@tcp:41:lfs.0 00000004:00000024:3.0:1788625543.029254:0:22800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625543.029354:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18235:x1875509185238144:12345-192.168.204.14@tcp:41:lfs.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.029362:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00080000:0.0:1788625543.033994:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625543.034945:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.035030:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238272 00000100:00100000:0.0:1788625543.035043:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238272 00000100:00100000:0.0:1788625543.035142:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625543.035154:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18235:x1875509185238272:12345-192.168.204.14@tcp:13:lfs.0 00002000:00000024:0.0:1788625543.035183:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625543.035281:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18235:x1875509185238272:12345-192.168.204.14@tcp:13:lfs.0 Request processed in 130us (344us total) trans 0 rc 0/0 00000100:00080000:3.0:1788625543.035395:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625543.035423:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:2.0:1788625543.043633:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.043884:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238400 00000100:00100000:0.0:1788625543.043897:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238400 00000100:00100000:0.0:1788625543.044010:0:25591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625543.044022:0:25591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18235:x1875509185238400:12345-192.168.204.14@tcp:13:lfs.0 00002000:00000024:0.0:1788625543.044060:0:25591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788625543.044152:0:25591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18235:x1875509185238400:12345-192.168.204.14@tcp:13:lfs.0 Request processed in 133us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625543.044160:0:25591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00080000:3.0:1788625543.044954:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788625543.245336:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625543.294456:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.294580:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238528 00000100:00100000:1.0:1788625543.294592:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238528 00000100:00100000:1.0:1788625543.294664:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:1.0:1788625543.294674:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+10:18268:x1875509185238528:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625543.294720:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625543.294739:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743b41200/0x2d2e3b3f34a7c285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e6bf expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.294771:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b41200/0x2d2e3b3f34a7c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6bf expref: 11 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.294784:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743b41200/0x2d2e3b3f34a7c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6bf expref: 11 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.294792:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41200, rc 0) 00000100:00100000:1.0:1788625543.294868:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185238528:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 195us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.294876:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 129 00000100:00100000:2.0:1788625543.303765:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.305348:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238656 00000100:00100000:3.0:1788625543.305362:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238656 00000100:00100000:3.0:1788625543.305431:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:3.0:1788625543.305442:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185238656:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788625543.305654:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185238656:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 213us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.305662:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 130 00000100:00100000:2.0:1788625543.316303:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.317578:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238784 00000100:00100000:3.0:1788625543.317594:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238784 00000100:00100000:3.0:1788625543.317679:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:3.0:1788625543.317690:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185238784:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788625543.317894:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998860800c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185238784:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 196us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.317903:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 131 00000100:00100000:2.0:1788625543.354867:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.357553:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185238912 00000100:00100000:1.0:1788625543.357570:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185238912 00000100:00100000:1.0:1788625543.357659:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:1.0:1788625543.357672:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185238912:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625543.357887:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185238912:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 217us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.357895:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 132 00000100:00100000:0.0:1788625543.394115:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625543.395736:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239040 00000100:00100000:2.0:1788625543.395750:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239040 00000100:00100000:2.0:1788625543.396577:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:2.0:1788625543.396589:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185239040:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625543.396951:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185239040:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 362us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625543.397028:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 133 00000100:00100000:2.0:1788625543.402800:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.403128:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239168 00000100:00100000:3.0:1788625543.403138:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239168 00000100:00100000:3.0:1788625543.403631:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:3.0:1788625543.403728:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185239168:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788625543.404088:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18275:x1875509185239168:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 364us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.404096:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 134 00000100:00100000:0.0:1788625543.410094:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625543.410184:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239296 00000100:00100000:2.0:1788625543.410194:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239296 00000100:00100000:2.0:1788625543.410257:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:2.0:1788625543.410267:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18268:x1875509185239296:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788625543.410285:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625543.410304:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7c28c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e6f0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625543.410352:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7c28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f0 expref: 12 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625543.410365:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e5600/0x2d2e3b3f34a7c28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f0 expref: 12 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625543.410374:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5600, rc 0) 00000100:00100000:2.0:1788625543.410439:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18268:x1875509185239296:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625543.410446:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 135 00000100:00100000:0.0:1788625543.426848:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.426952:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239424 00000100:00100000:3.0:1788625543.426962:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239424 00000100:00100000:3.0:1788625543.427021:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:3.0:1788625543.427031:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18268:x1875509185239424:12345-192.168.204.14@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788625543.427064:0:22793:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788625543.427093:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788625543.427098:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788625543.427101:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788625543.427104:0:22793:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788625543.427106:0:22793:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788625543.430897:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18268:x1875509185239424:12345-192.168.204.14@tcp:256:mount.lustre.0 Request processed in 3854us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.430912:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 136 00000100:00100000:0.0:1788625543.434014:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.434229:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239552 00000100:00100000:1.0:1788625543.434239:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239552 00000100:00100000:1.0:1788625543.434297:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:1.0:1788625543.434506:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18268:x1875509185239552:12345-192.168.204.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788625543.434551:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625543.434582:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e6f7 expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.434614:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.434626:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625543.434645:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40a00, rc 0) 00000100:00100000:1.0:1788625543.434800:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18268:x1875509185239552:12345-192.168.204.14@tcp:101:mount.lustre.0 Request processed in 493us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.434807:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 137 00000100:00100000:0.0:1788625543.440838:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.440932:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239680 00000100:00100000:3.0:1788625543.440942:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239680 00000100:00100000:3.0:1788625543.441037:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:3.0:1788625543.441046:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18268:x1875509185239680:12345-192.168.204.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788625543.441205:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18268:x1875509185239680:12345-192.168.204.14@tcp:501:mount.lustre.0 Request processed in 159us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.441213:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 138 00000100:00100000:2.0:1788625543.444099:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.444198:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239808 00000100:00100000:1.0:1788625543.444208:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239808 00000100:00100000:1.0:1788625543.444296:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:1.0:1788625543.444319:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18268:x1875509185239808:12345-192.168.204.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788625543.444455:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18268:x1875509185239808:12345-192.168.204.14@tcp:503:mount.lustre.0 Request processed in 150us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.444462:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 139 00000100:00100000:0.0:1788625543.451583:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.451868:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185239936 00000100:00100000:3.0:1788625543.451880:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185239936 00000100:00100000:3.0:1788625543.451936:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:3.0:1788625543.451963:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18280:x1875509185239936:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788625543.453067:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18280:x1875509185239936:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 1101us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625543.453080:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 140 00000100:00100000:0.0:1788625543.463671:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.463773:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240064 00000100:00100000:1.0:1788625543.463783:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240064 00000100:00100000:1.0:1788625543.463839:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 141 00000100:00100000:1.0:1788625543.463848:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18280:x1875509185240064:12345-192.168.204.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788625543.464010:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18280:x1875509185240064:12345-192.168.204.14@tcp:502:llog_process_th.0 Request processed in 162us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.464017:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 141 00000100:00100000:0.0:1788625543.481237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.481290:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.481315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.481734:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.481761:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.492958:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240192 00000100:00100000:1.0:1788625543.492973:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240192 00000100:00100000:1.0:1788625543.493021:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240448 00000100:00100000:1.0:1788625543.493025:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240448 00000100:00100000:1.0:1788625543.493037:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240832 00000100:00100000:1.0:1788625543.493040:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240832 00000100:00100000:0.0:1788625543.493043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625543.493067:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240960 00000100:00100000:1.0:1788625543.493070:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240960 00000100:00100000:0.0:1788625543.493085:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241088 00000100:00100000:1.0:1788625543.493092:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:0.0:1788625543.493093:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241088 00000100:00100000:1.0:1788625543.493103:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2392:x1875509185240832:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625543.493131:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241216 00000100:00100000:0.0:1788625543.493135:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241216 00000100:00100000:0.0:1788625543.493164:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625543.493174:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185241088:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625543.493184:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2392:x1875509185240832:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 82us (11865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.493191:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:1.0:1788625543.493213:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:0.0:1788625543.493213:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744078a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185241088:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 39us (11476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.493224:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2392:x1875509185240960:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625543.493226:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625543.493248:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625543.493257:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2392:x1875509185240960:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 34us (11494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625543.493259:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185241216:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625543.493269:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:1.0:1788625543.493285:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:1.0:1788625543.493291:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185240192:12345-192.168.204.14@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788625543.493300:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185241216:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625543.493307:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00010000:00080000:1.0:1788625543.493315:0:22799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e10baa21-d455-4ab1-8b08-cff99c0f467e@192.168.204.14@tcp t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:1.0:1788625543.493354:0:22799:0:(genops.c:1385:class_connect()) connect: client e10baa21-d455-4ab1-8b08-cff99c0f467e, cookie 0x2d2e3b3f34a7c29a 00000004:00100000:1.0:1788625543.493378:0:22799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788625543.493483:0:22799:0:(import.c:65:import_set_state_nolock()) ffff998741dda800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625543.493540:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2390:x1875509185240192:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 248us (12315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.493556:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:1.0:1788625543.493569:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625543.493574:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1875509185240448:12345-192.168.204.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788625543.493587:0:22799:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e10baa21-d455-4ab1-8b08-cff99c0f467e@192.168.204.14@tcp t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:1.0:1788625543.493608:0:22799:0:(genops.c:1385:class_connect()) connect: client e10baa21-d455-4ab1-8b08-cff99c0f467e, cookie 0x2d2e3b3f34a7c2a1 00000004:00100000:1.0:1788625543.493619:0:22799:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788625543.493741:0:22799:0:(import.c:65:import_set_state_nolock()) ffff998741dde800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788625543.493763:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2390:x1875509185240448:12345-192.168.204.14@tcp:38:mount.lustre.0 Request processed in 188us (12473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625543.493770:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:0.0:1788625543.523257:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.523301:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.523343:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.525458:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240704 00000100:00100000:3.0:1788625543.525473:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240704 00000100:00100000:3.0:1788625543.525577:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240320 00000100:00100000:3.0:1788625543.525581:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240320 00000100:00100000:3.0:1788625543.525595:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185240576 00000100:00100000:3.0:1788625543.525598:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185240576 00000100:00100000:3.0:1788625543.525620:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625543.525631:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+7:18268:x1875509185240704:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625543.525677:0:24101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788625543.525899:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+7:18268:x1875509185240704:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 269us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.525908:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:3.0:1788625543.525930:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625543.525937:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:0:x1875509185240320:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625543.525950:0:24101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788625543.525973:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:0:x1875509185240320:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 37us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.525979:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625543.525990:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:3.0:1788625543.525996:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:0:x1875509185240576:12345-192.168.204.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788625543.526007:0:24101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625543.526032:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:0:x1875509185240576:12345-192.168.204.14@tcp:41:mount.lustre.0 Request processed in 36us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.526038:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00080000:0.0:1788625543.527369:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625543.527378:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625543.528446:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.528486:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241344 00000100:00100000:3.0:1788625543.528495:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241344 00000100:00100000:3.0:1788625543.528566:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625543.528575:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241344:12345-192.168.204.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788625543.528653:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241344:12345-192.168.204.14@tcp:40:mount.lustre.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.528660:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625543.531114:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.531159:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.531191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625543.531255:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241472 00000100:00100000:2.0:1788625543.531265:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241472 00000100:00100000:1.0:1788625543.531275:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241600 00000100:00100000:1.0:1788625543.531281:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241600 00000100:00100000:2.0:1788625543.531315:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625543.531324:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185241472:12345-192.168.204.14@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788625543.531350:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241728 00000100:00100000:0.0:1788625543.531355:0:22811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241728 00010000:00080000:2.0:1788625543.531358:0:24307:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e10baa21-d455-4ab1-8b08-cff99c0f467e@192.168.204.14@tcp t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:2.0:1788625543.531390:0:24307:0:(genops.c:1385:class_connect()) connect: client e10baa21-d455-4ab1-8b08-cff99c0f467e, cookie 0x2d2e3b3f34a7c2a8 00000100:00100000:0.0:1788625543.531395:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00002000:00100000:2.0:1788625543.531405:0:24307:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e10baa21-d455-4ab1-8b08-cff99c0f467e/ffff9988771d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788625543.531418:0:22811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241728:12345-192.168.204.14@tcp:900:mount.lustre.0 00002000:00100000:2.0:1788625543.531420:0:24307:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788625543.531483:0:22811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241728:12345-192.168.204.14@tcp:900:mount.lustre.0 Request processed in 66us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625543.531490:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00002000:00080000:2.0:1788625543.531512:0:24307:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788625543.531569:0:24307:0:(import.c:65:import_set_state_nolock()) ffff9988771d5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625543.531604:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2390:x1875509185241472:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 279us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625543.531621:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625543.531654:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:2.0:1788625543.531660:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875509185241600:12345-192.168.204.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788625543.531679:0:24307:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e10baa21-d455-4ab1-8b08-cff99c0f467e@192.168.204.14@tcp t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:2.0:1788625543.531695:0:24307:0:(genops.c:1385:class_connect()) connect: client e10baa21-d455-4ab1-8b08-cff99c0f467e, cookie 0x2d2e3b3f34a7c2af 00002000:00100000:2.0:1788625543.531700:0:24307:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e10baa21-d455-4ab1-8b08-cff99c0f467e/ffff9988771d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788625543.531706:0:24307:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788625543.531743:0:24307:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788625543.531881:0:24307:0:(import.c:65:import_set_state_nolock()) ffff9988771d1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788625543.531919:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2390:x1875509185241600:12345-192.168.204.14@tcp:8:mount.lustre.0 Request processed in 258us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625543.531927:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:3.0:1788625543.544153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625543.546732:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241856 00000100:00100000:0.0:1788625543.546814:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241856 00000100:00100000:0.0:1788625543.546939:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:0.0:1788625543.546952:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241856:12345-192.168.204.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788625543.547039:0:22803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788625543.547149:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18268:x1875509185241856:12345-192.168.204.14@tcp:33:mount.lustre.0 Request processed in 199us (3058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625543.547157:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00000040:00080000:0.0:1788625543.692484:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625543.701124:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625543.701236:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185241984 00000100:00100000:3.0:1788625543.701246:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185241984 00000100:00100000:3.0:1788625543.701312:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:3.0:1788625543.701322:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18303:x1875509185241984:12345-192.168.204.14@tcp:101:mkdir.0 00010000:00010000:3.0:1788625543.701340:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625543.701363:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c2b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e728 expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701423:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701437:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701451:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625543.701511:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625543.701551:0:22801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625543.701573:0:22801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701598:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c2b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 8 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701615:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 7 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625543.701624:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:3.0:1788625543.701627:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625543.701642:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682600, rc 0) 00000100:00100000:3.0:1788625543.701826:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+7:18303:x1875509185241984:12345-192.168.204.14@tcp:101:mkdir.0 Request processed in 505us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625543.701834:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00010000:00010000:0.0:1788625544.267908:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625545.293578:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788625545.999268:0:22779:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e10baa21-d455-4ab1-8b08-cff99c0f467e 00000001:00100000:0.0:1788625545.999282:0:22779:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca0f9b0c-1e13-4da9-865b-75626250b5f8 00000001:00100000:3.0:1788625546.006374:0:23531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e10baa21-d455-4ab1-8b08-cff99c0f467e 00000001:00100000:3.0:1788625546.006389:0:23531:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca0f9b0c-1e13-4da9-865b-75626250b5f8 00010000:00010000:3.0:1788625546.316351:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788625546.998844:0:25677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788625547.019906:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625547.019928:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206314368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625547.019997:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.020070:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788625547.020079:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625547.020105:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.020151:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314368 00000100:00100000:3.0:1788625547.020159:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314368 00000100:00100000:3.0:1788625547.020207:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314496 00000100:00100000:3.0:1788625547.020211:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314496 00000100:00100000:3.0:1788625547.020227:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625547.020236:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206314368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788625547.020265:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788625547.020310:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206314368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.020317:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625547.020333:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625547.020338:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206314496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788625547.020352:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788625547.020379:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206314496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.020384:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788625547.020401:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788625547.020404:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625547.020425:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788625547.020446:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788625547.020469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206314368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788625547.022162:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206314624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625547.022216:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.022265:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314624 00000100:00100000:3.0:1788625547.022270:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314624 00000100:00100000:3.0:1788625547.022314:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625547.022321:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206314624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625547.022345:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788625547.022386:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206314624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.022392:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788625547.022412:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625547.022442:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206314624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625547.022832:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206315008:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.022864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625547.022888:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206315520:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.022913:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625547.022931:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788625547.022935:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206315136:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.022955:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625547.022972:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206315648:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.022998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625547.023039:0:25380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315008 00000100:00100000:0.0:1788625547.023043:0:25380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315008 00000100:00100000:0.0:1788625547.023077:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625547.023084:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206315008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023120:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206315008:12345-0@lo:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625547.023126:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788625547.023145:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315520 00000100:00100000:0.0:1788625547.023148:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315520 00000100:00100000:0.0:1788625547.023170:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315136 00000100:00100000:0.0:1788625547.023174:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315136 00000100:00100000:0.0:1788625547.023184:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315648 00000100:00100000:0.0:1788625547.023186:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315648 00000100:00100000:0.0:1788625547.023198:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625547.023204:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206315520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023232:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875509206315520:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625547.023237:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788625547.023248:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625547.023253:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206315136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023277:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875509206315136:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625547.023283:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788625547.023294:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788625547.023298:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206315648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023323:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875509206315648:12345-0@lo:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625547.023334:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788625547.023359:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788625547.023361:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788625547.023363:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625547.023383:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875509206315136:0@lo:400:kworker.0 00010000:00080000:0.0:1788625547.023395:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998744228000 x1875509206315648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625547.023405:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875509206315648:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023414:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206315008:0@lo:400:kworker.0 00000100:00100000:0.0:1788625547.023422:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875509206315520:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023740:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206314752:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023775:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.023818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023843:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.023864:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206315776:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023884:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.023905:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788625547.023911:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206314880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023931:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.023949:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206315392:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.023966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.023982:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024006:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.024044:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315264 00000100:00100000:3.0:1788625547.024050:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315264 00000100:00100000:3.0:1788625547.024076:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314880 00000100:00100000:3.0:1788625547.024079:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314880 00000100:00100000:3.0:1788625547.024093:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625547.024098:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024147:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206315264:12345-0@lo:400:kworker.0 Request processed in 48us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.024154:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788625547.024167:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625547.024173:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206314880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024200:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206314880:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.024205:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625547.024224:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315776 00000100:00100000:3.0:1788625547.024227:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315776 00000100:00100000:3.0:1788625547.024249:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315392 00000100:00100000:3.0:1788625547.024252:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315392 00000100:00100000:3.0:1788625547.024260:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206315904 00000100:00100000:3.0:1788625547.024263:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206315904 00000100:00100000:3.0:1788625547.024275:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625547.024281:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206315776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024324:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875509206315776:12345-0@lo:400:kworker.0 Request processed in 43us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.024331:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788625547.024342:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625547.024347:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206315392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024372:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875509206315392:12345-0@lo:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.024377:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788625547.024386:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625547.024391:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206315904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024420:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875509206315904:12345-0@lo:400:kworker.0 Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.024426:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788625547.024442:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788625547.024444:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788625547.024466:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206314880:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998744229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875509206315392:0@lo:400:kworker.0 00010000:00080000:3.0:1788625547.024485:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99874422aa00 x1875509206315904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625547.024493:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875509206315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024502:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788625547.024510:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875509206315776:0@lo:400:kworker.0 00000100:00100000:2.0:1788625547.024833:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206314752 00000100:00100000:2.0:1788625547.024838:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206314752 00000100:00100000:2.0:1788625547.024874:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788625547.024880:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3637:x1875509206314752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625547.024923:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3637:x1875509206314752:12345-0@lo:400:kworker.0 Request processed in 43us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625547.024929:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788625547.024959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3637:1875509206314752:0@lo:400:kworker.0 00000100:00100000:1.0:1788625547.026556:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788625547.026584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206316032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788625547.026649:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625547.026693:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316032 00000100:00100000:1.0:1788625547.026699:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316032 00000100:00100000:1.0:1788625547.026737:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625547.026744:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206316032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625547.026765:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788625547.026807:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206316032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625547.026814:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788625547.026853:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988442a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206316032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788625547.339700:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788625547.533008:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788625547.533029:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206316160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625547.533100:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625547.533204:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316160 00000100:00100000:0.0:1788625547.533214:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316160 00000100:00100000:0.0:1788625547.533269:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788625547.533279:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206316160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625547.533321:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788625547.533380:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206316160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625547.533387:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788625547.533495:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206316160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788625547.533922:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788625547.533935:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206316288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625547.533969:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625547.534044:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316288 00000100:00100000:3.0:1788625547.534050:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316288 00000100:00100000:3.0:1788625547.534083:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788625547.534090:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206316288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625547.534110:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625547.534156:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206316288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625547.534162:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788625547.534375:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206316288:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788625548.365853:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788625548.431750:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788625548.806014:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625548.806059:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625548.806142:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242112 00000100:00100000:2.0:1788625548.806164:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242112 00000100:00100000:2.0:1788625548.806218:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:2.0:1788625548.806229:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2393:x1875509185242112:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625548.806321:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2393:x1875509185242112:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625548.806328:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 143 00000100:00100000:1.0:1788625548.807465:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625548.812762:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242240 00000100:00100000:0.0:1788625548.812780:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242240 00000100:00080000:0.0:1788625548.812821:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625548.812846:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625548.812875:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625548.812977:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625548.819174:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625548.819419:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242368 00000100:00100000:0.0:1788625548.819430:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242368 00000100:00080000:0.0:1788625548.819458:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625548.819489:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242752 00000100:00100000:0.0:1788625548.819504:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242752 00000100:00080000:0.0:1788625548.819542:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625548.819574:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:0.0:1788625548.819584:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2393:x1875509185242240:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.819659:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2393:x1875509185242240:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 77us (13600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.819666:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:0.0:1788625548.819682:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:0.0:1788625548.819688:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242368:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.819707:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242368:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (12248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.819712:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:0.0:1788625548.819722:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:0.0:1788625548.819727:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2391:x1875509185242752:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.819742:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2391:x1875509185242752:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 16us (6767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.819748:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:0.0:1788625548.819794:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242496 00000100:00100000:0.0:1788625548.819798:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242496 00000100:00100000:0.0:1788625548.819827:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242624 00000100:00100000:0.0:1788625548.819830:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242624 00000100:00100000:0.0:1788625548.819861:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625548.819867:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242496:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.819892:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242496:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 25us (7057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.819907:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625548.819920:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625548.819926:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242624:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.819949:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988442a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2391:x1875509185242624:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (7075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.819955:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00080000:0.0:1788625548.820050:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788625548.820053:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625548.820919:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185242880 00000100:00100000:0.0:1788625548.820925:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185242880 00000100:00080000:0.0:1788625548.820945:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625548.820977:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:0.0:1788625548.820985:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2391:x1875509185242880:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.821029:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2391:x1875509185242880:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 46us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.821036:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:1.0:1788625548.821222:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625548.821579:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243008 00000100:00100000:0.0:1788625548.821584:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243008 00000100:00100000:0.0:1788625548.821621:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:0.0:1788625548.821629:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2392:x1875509185243008:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625548.821666:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2392:x1875509185243008:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 37us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625548.821672:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00080000:0.0:1788625548.821687:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788625548.821883:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625548.821911:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243136 00000100:00100000:1.0:1788625548.821915:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243136 00000100:00100000:1.0:1788625548.821949:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:1.0:1788625548.821957:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2391:x1875509185243136:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625548.821985:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2391:x1875509185243136:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 30us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625548.821992:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00080000:1.0:1788625548.822024:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788625549.076104:0:25118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e10baa21-d455-4ab1-8b08-cff99c0f467e 00000001:00100000:2.0:1788625549.076194:0:24301:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e10baa21-d455-4ab1-8b08-cff99c0f467e 00010000:00010000:3.0:1788625549.389987:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625550.414345:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788625550.666787:0:25825:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda8d1d810 20000000:00000080:1.0:1788625550.666806:0:25825:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99887e321000 uarg=0000000000000000 20000000:01000000:1.0:1788625550.666855:0:25825:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625550.666863:0:25825:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788625550.666869:0:25825:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788625550.667458:0:25826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788625550.669266:0:25825:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788625550.673759:0:25825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788625550.673792:0:25825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673814:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673823:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673830:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673838:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673849:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673857:0:25825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673865:0:25825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673913:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.673931:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 12 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.673946:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316416:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625550.674120:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.674129:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.674138:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316544:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625550.674169:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.674177:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.674186:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316672:0@lo:104: 00000100:00100000:1.0:1788625550.674224:0:25825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625550.674270:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.674278:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.674287:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316800:0@lo:104: 00000100:00100000:1.0:1788625550.674307:0:25825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625550.674790:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.674800:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.674808:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316928:0@lo:104: 00000100:00100000:3.0:1788625550.674824:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316672 00000100:00100000:3.0:1788625550.674832:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316672 00000100:00100000:1.0:1788625550.674837:0:25825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788625550.674855:0:25825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 23 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.674862:0:25825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625550.674869:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316800 00000100:00100000:1.0:1788625550.674870:0:25825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206317056:0@lo:104: 00000100:00100000:3.0:1788625550.674872:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316800 00000100:00100000:3.0:1788625550.674881:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206316928 00000100:00100000:3.0:1788625550.674884:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206316928 00000100:00100000:1.0:1788625550.674887:0:25825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625550.674892:0:22782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317056 00000100:00100000:3.0:1788625550.674895:0:22782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317056 00000100:00100000:1.0:1788625550.674898:0:25825:0:(client.c:2716:ptlrpc_set_wait()) set ffff998861f82cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625550.674909:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625550.674918:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:25825:x1875509206316672:12345-0@lo:104: 00010000:00010000:3.0:1788625550.674933:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675004:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788625550.675010:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+6:25825:x1875509206316672:12345-0@lo:104: Request processed in 93us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625550.675016:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788625550.675034:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625550.675039:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:25825:x1875509206316800:12345-0@lo:104: 00010000:00010000:3.0:1788625550.675046:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675088:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788625550.675093:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+5:25825:x1875509206316800:12345-0@lo:104: Request processed in 54us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625550.675099:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788625550.675110:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788625550.675115:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:25825:x1875509206316928:12345-0@lo:104: 00010000:00010000:3.0:1788625550.675122:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675143:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625550.675150:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675157:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1788625550.675158:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682400 already unused, calling callback (ffffffffc13d7c20) 00000100:00100000:3.0:1788625550.675162:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+4:25825:x1875509206316928:12345-0@lo:104: Request processed in 46us (323us total) trans 0 rc 0/0 10000000:00010000:2.0:1788625550.675163:0:25134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625550.675168:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788625550.675172:0:25134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625550.675179:0:25134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625550.675180:0:22782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788625550.675185:0:22782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:25825:x1875509206317056:12345-0@lo:104: 10000000:01000000:2.0:1788625550.675185:0:25134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625550.675191:0:22782:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675211:0:25134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675214:0:22782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1788625550.675217:0:25134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788625550.675218:0:22782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+3:25825:x1875509206317056:12345-0@lo:104: Request processed in 34us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625550.675223:0:22782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788625550.675237:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788625550.675241:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675242:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675249:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683200 already unused, calling callback (ffffffffc13d7c20) 00010000:00010000:2.0:1788625550.675250:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b682400/0x2d2e3b3f34a7c001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7c008 expref: -99 pid: 25117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625550.675252:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675259:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675263:0:25134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788625550.675266:0:25134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788625550.675267:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625550.675273:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788625550.675273:0:25134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887da21000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1788625550.675276:0:25134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675282:0:25134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788625550.675288:0:25134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675291:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625550.675294:0:25134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788625550.675297:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788625550.675303:0:25134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675309:0:25134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625550.675312:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675314:0:25134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675319:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887b683200/0x2d2e3b3f34a7bf67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf6e expref: -99 pid: 24300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675320:0:25134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff99887da21000/0x2d2e3b3f34a7bf28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf2f expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675329:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625550.675332:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675337:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc13d7c20) 00010000:00010000:2.0:1788625550.675338:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788625550.675340:0:22787:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675340:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788625550.675342:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625550.675347:0:22787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.675348:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788625550.675353:0:22787:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788625550.675358:0:22787:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788625550.675365:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206317184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788625550.675372:0:22787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.675376:0:22787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788625550.675382:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625550.675393:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625550.675416:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625550.675421:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206317568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625550.675440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625550.675466:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206317312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625550.675485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625550.675584:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316672:0@lo:104: 00000100:00100000:1.0:1788625550.675596:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316800:0@lo:104: 00000100:00100000:1.0:1788625550.675602:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316928:0@lo:104: 00000100:00100000:1.0:1788625550.675608:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206317056:0@lo:104: 00000100:00100000:2.0:1788625550.675722:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625550.675728:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206317440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625550.675750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625550.675827:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317184 00000100:00100000:1.0:1788625550.675832:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317184 00010000:00010000:1.0:1788625550.675857:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 24 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.675873:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317568 00000100:00100000:1.0:1788625550.675875:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317568 00010000:00010000:1.0:1788625550.675885:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 25 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.675895:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317312 00000100:00100000:1.0:1788625550.675897:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317312 00010000:00010000:1.0:1788625550.675906:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 26 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.675916:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317440 00000100:00100000:1.0:1788625550.675925:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317440 00010000:00010000:1.0:1788625550.675937:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 27 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.675950:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625550.675956:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+27:3638:x1875509206317184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625550.675967:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625550.675972:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 27 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.675981:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 27 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.675994:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887da20800/0x2d2e3b3f34a7c008 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7c001 expref: 27 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676007:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625550.676037:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+26:3638:x1875509206317184:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625550.676044:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788625550.676058:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625550.676064:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+25:3638:x1875509206317568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625550.676071:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625550.676075:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 25 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676083:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 25 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676093:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99887da21a00/0x2d2e3b3f34a7bf21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf1a expref: 25 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676108:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625550.676130:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3638:x1875509206317568:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625550.676136:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788625550.676149:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788625550.676155:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:3635:x1875509206317312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788625550.676163:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625550.676167:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676175:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676185:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5e00/0x2d2e3b3f34a7bf6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf67 expref: 23 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.676192:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625550.676221:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:3635:x1875509206317312:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625550.676227:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788625550.676238:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625550.676250:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:3635:x1875509206317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625550.676261:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625550.676267:0:23551:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 21 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625550.676279:0:23551:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 21 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625550.676286:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206317568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788625550.676295:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3638:1875509206317184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788625550.676309:0:23551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5800/0x2d2e3b3f34a7bf2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2d2e3b3f34a7bf28 expref: 21 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625550.676321:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625550.676328:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206317312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788625550.676362:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:3635:x1875509206317440:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (609us total) trans 0 rc 0/0 00010000:00010000:3.0:1788625550.676457:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.114@tcp lock: ffff9988412e4800/0x2d2e3b3f34a7bf1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2d2e3b3f34a7bf21 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.676472:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625550.676474:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625550.676475:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625550.676580:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788625550.676609:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206317440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788625550.681942:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316416:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625550.681960:0:25825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25825:1875509206316544:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625550.682004:0:25825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625550.686315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625550.688258:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243264 00000100:00100000:2.0:1788625550.688275:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243264 00010000:00010000:2.0:1788625550.688323:0:22785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625550.688368:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:2.0:1788625550.688378:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2393:x1875509185243264:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625550.688419:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625550.688426:0:22785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.688438:0:22785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.688456:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743b40a00/0x2d2e3b3f34a7c293 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6f7 expref: 13 pid: 22794 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625550.688469:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625550.688555:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:2393:x1875509185243264:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 179us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625550.688562:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:0.0:1788625550.689216:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625550.689899:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243392 00000100:00100000:1.0:1788625550.689907:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243392 00010000:00010000:1.0:1788625550.689934:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625550.689964:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625550.689973:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:2394:x1875509185243392:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625550.689996:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625550.690001:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690014:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690029:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9988412e5000/0x2d2e3b3f34a7c254 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e687 expref: 12 pid: 22792 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690045:0:22786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690054:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690079:0:22786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690087:0:22786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690094:0:22786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690101:0:22786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690108:0:22786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41e00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:1.0:1788625550.690112:0:22786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690130:0:22786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690151:0:22786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625550.690161:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625550.690203:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:2394:x1875509185243392:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 231us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625550.690210:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00010000:00010000:3.0:1788625550.690372:0:25825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.690381:0:25825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625550.690389:0:25825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998743b41e00/0x2d2e3b3f34a7c2c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.438252:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788625551.938115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625551.938941:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243520 00000100:00100000:3.0:1788625551.938951:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243520 00000100:00100000:3.0:1788625551.939016:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 144 00000100:00100000:3.0:1788625551.939026:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+11:18153:x1875509185243520:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625551.939044:0:22794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625551.939062:0:22794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7c2cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e72f expref: -99 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.939109:0:22794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7c2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e72f expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.939120:0:22794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b683200/0x2d2e3b3f34a7c2cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e72f expref: 12 pid: 22794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.939129:0:22794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683200, rc 0) 00000100:00100000:3.0:1788625551.939697:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243520:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 670us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625551.939705:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 144 10000000:01000000:2.0:1788625551.948347:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625551.948364:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998742687000 from 13 10000000:01000000:2.0:1788625551.948370:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625551.948421:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.948443:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.948455:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625551.948492:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625551.948601:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625551.948666:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625551.949041:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317696 00000100:00100000:3.0:1788625551.949050:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317696 00000100:00100000:3.0:1788625551.949105:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788625551.949116:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+20:22796:x1875509206317696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788625551.949129:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625551.949143:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7c2d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c2d2 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.949178:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7c2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2d2 expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.949198:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99887b682000/0x2d2e3b3f34a7c2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2d2 expref: 21 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625551.949208:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682000, rc 0) 00000100:00100000:3.0:1788625551.949265:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887dfba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206317696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625551.949281:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788625551.949573:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625551.949591:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2d9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.949600:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c2d9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625551.949660:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625551.949687:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625551.949722:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998861f82000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625551.951174:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317824 00000100:00100000:3.0:1788625551.951182:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317824 00000100:00100000:3.0:1788625551.951235:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788625551.951242:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206317824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625551.951378:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206317824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625551.951386:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788625551.951822:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625551.951863:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625551.951918:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625551.951952:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998861f82000 going to sleep for 11 seconds 00000100:00100000:0.0:1788625551.952060:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206317952 00000100:00100000:0.0:1788625551.952065:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206317952 00000100:00100000:0.0:1788625551.952087:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788625551.952094:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206317952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625551.952201:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206317952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625551.952208:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788625551.952680:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206317952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788625551.954116:0:25839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788625551.957499:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788625551.957609:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625551.957622:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2d9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625551.957624:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00010000:00010000:1.0:1788625551.957633:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e5400/0x2d2e3b3f34a7c2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2d9 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625551.957644:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625551.957646:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99885ee8a800 from 13 10000000:01000000:1.0:1788625551.957649:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625551.957684:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.957693:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.957705:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625551.957728:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788625551.957734:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243648 00000100:00100000:3.0:1788625551.957750:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243648 00000100:00100000:1.0:1788625551.957836:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625551.958094:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998861f82000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625551.964456:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318080 00000100:00100000:3.0:1788625551.965926:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318080 00000100:00100000:3.0:1788625551.966017:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:3.0:1788625551.966031:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243648:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625551.966178:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788625551.966193:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+21:22796:x1875509206318080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788625551.966206:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625551.966230:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7c2e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c2e0 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.966330:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7c2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2e0 expref: 22 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.966345:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9988412e4c00/0x2d2e3b3f34a7c2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2e0 expref: 22 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625551.966357:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4c00, rc 0) 00000100:00100000:3.0:1788625551.967350:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243648:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 1317us (9723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625551.967362:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 148 00000100:00100000:2.0:1788625551.972154:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5950us (14302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625551.972169:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788625551.973199:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625551.973237:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2e7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625551.973316:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c2e7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625551.973720:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625551.973791:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625551.973888:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625551.973931:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318208 00000100:00100000:2.0:1788625551.973939:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318208 00000100:00100000:2.0:1788625551.974040:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788625551.974052:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788625551.974272:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625551.974280:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788625551.980060:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625551.980176:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625551.980386:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625551.981051:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625551.982680:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625551.982800:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318336 00000100:00100000:3.0:1788625551.982811:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318336 00000100:00100000:3.0:1788625551.982872:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788625551.982882:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625551.983076:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625551.983084:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788625551.983388:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788625551.985760:0:25840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788625551.985849:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788625551.985881:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788625551.985896:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2e7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.985922:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743b40c00/0x2d2e3b3f34a7c2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2e7 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788625551.985937:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788625551.985940:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998874b51800 from 13 10000000:01000000:1.0:1788625551.985943:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788625551.985988:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.985997:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625551.986009:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625551.986038:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625551.986282:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243776 00000100:00100000:2.0:1788625551.986292:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243776 00000100:00100000:1.0:1788625551.986453:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625551.991746:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998861f82000 going to sleep for 11 seconds 00000100:00100000:3.0:1788625551.998462:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 152 00000100:00100000:3.0:1788625551.998967:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243776:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625552.002013:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243776:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 3046us (20950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.002030:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 152 00000100:00100000:0.0:1788625552.006066:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318464 00000100:00100000:0.0:1788625552.006088:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318464 00000100:00100000:0.0:1788625552.006204:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788625552.006217:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+22:22796:x1875509206318464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625552.006239:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625552.006387:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998742669e00/0x2d2e3b3f34a7c2f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c2ee expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.006437:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998742669e00/0x2d2e3b3f34a7c2f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2ee expref: 23 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.006451:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998742669e00/0x2d2e3b3f34a7c2f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c2ee expref: 23 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.006579:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998742669e00, rc 0) 00000100:00100000:0.0:1788625552.006696:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 482us (20242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.006704:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788625552.006807:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625552.006830:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2f5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.006843:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c2f5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625552.006949:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625552.006989:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.007024:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625552.007041:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318592 00000100:00100000:0.0:1788625552.007044:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318592 00000100:00100000:0.0:1788625552.007067:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788625552.007074:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.013010:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5921us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.013029:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788625552.014326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625552.014460:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185243904 00000100:00100000:1.0:1788625552.014487:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185243904 00000100:00100000:1.0:1788625552.014589:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:1.0:1788625552.014601:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+12:18153:x1875509185243904:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625552.014622:0:22793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625552.014646:0:22793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743b40800/0x2d2e3b3f34a7c2fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e736 expref: -99 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.014704:0:22793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b40800/0x2d2e3b3f34a7c2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e736 expref: 13 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.014719:0:22793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743b40800/0x2d2e3b3f34a7c2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e736 expref: 13 pid: 22793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.014731:0:22793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40800, rc 0) 00000100:00100000:1.0:1788625552.014793:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18153:x1875509185243904:12345-192.168.204.14@tcp:101:ll_cfg_requeue.0 Request processed in 195us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.014801:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 155 00000100:00100000:2.0:1788625552.016355:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.019454:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.020438:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.020710:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625552.020810:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff998846425600 going to sleep for 11 seconds 00000100:00100000:2.0:1788625552.025338:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318720 00000100:00100000:2.0:1788625552.025381:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318720 00000100:00100000:3.0:1788625552.025393:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244032 00000100:00100000:3.0:1788625552.025401:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244032 00000100:00100000:3.0:1788625552.025502:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:3.0:1788625552.026095:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18153:x1875509185244032:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788625552.026447:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18153:x1875509185244032:12345-192.168.204.14@tcp:501:ll_cfg_requeue.0 Request processed in 933us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.026457:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 156 00000100:00100000:1.0:1788625552.032866:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788625552.032884:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.033632:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99887f8a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 750us (13196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.033643:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788625552.036231:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625552.037492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000040:00080000:1.0:1788625552.037976:0:25841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788625552.039234:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788625552.039288:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625552.039305:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2f5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.039319:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff998743b41000/0x2d2e3b3f34a7c2ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c2f5 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788625552.039332:0:22796:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788625552.039336:0:22796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998872de2800 from 13 10000000:01000000:2.0:1788625552.039338:0:22796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788625552.039392:0:22796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.039401:0:22796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.039426:0:22796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625552.039460:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788625552.039582:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625552.045387:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244160 00000100:00100000:3.0:1788625552.045409:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244160 00000100:00100000:3.0:1788625552.050871:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318848 00000100:00100000:3.0:1788625552.050895:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318848 00000100:00100000:1.0:1788625552.054145:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 158 00000100:00100000:1.0:1788625552.054183:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18153:x1875509185244160:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.054567:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:18153:x1875509185244160:12345-192.168.204.14@tcp:503:ll_cfg_requeue.0 Request processed in 404us (17079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.054578:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 158 00000100:00100000:1.0:1788625552.054646:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788625552.054655:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+23:22796:x1875509206318848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788625552.054666:0:22792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625552.054690:0:22792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998743b41800/0x2d2e3b3f34a7c30a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2d2e3b3f34a7c303 expref: -99 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.054732:0:22792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998743b41800/0x2d2e3b3f34a7c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c303 expref: 24 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.054746:0:22792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998743b41800/0x2d2e3b3f34a7c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2d2e3b3f34a7c303 expref: 24 pid: 22792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.054757:0:22792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41800, rc 0) 00000100:00100000:1.0:1788625552.054828:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206318848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (15245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.054834:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788625552.055380:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788625552.055418:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788625552.055445:0:22796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c30a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.055485:0:22796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2d2e3b3f34a7c30a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625552.055601:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625552.059149:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.059205:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788625552.059365:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206318976 00000100:00100000:1.0:1788625552.059376:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206318976 00000100:00100000:1.0:1788625552.059434:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788625552.059445:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206318976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788625552.059674:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206318976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.059683:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788625552.059853:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206318976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788625552.059916:0:22796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206319104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788625552.060046:0:22796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.060076:0:22796:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625552.060145:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319104 00000100:00100000:3.0:1788625552.060150:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319104 00000100:00100000:3.0:1788625552.060193:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788625552.060201:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206319104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788625552.060452:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:22796:x1875509206319104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.060460:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788625552.060580:0:22796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:22796:1875509206319104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788625552.061846:0:25842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788625552.061994:0:22796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788625552.062030:0:22796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788625552.062046:0:22796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c30a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.062060:0:22796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.114@tcp lock: ffff9988412e5000/0x2d2e3b3f34a7c303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2d2e3b3f34a7c30a expref: -99 pid: 22796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625552.139903:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788625552.139935:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206319232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788625552.140040:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625552.140121:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319232 00000100:00100000:3.0:1788625552.140148:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319232 00000100:00100000:3.0:1788625552.140213:0:25591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788625552.140223:0:25591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206319232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788625552.140267:0:25591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788625552.140319:0:25591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875509206319232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.140326:0:25591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788625552.140351:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788625552.140390:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875509206319232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625552.140753:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206319360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625552.140785:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.140820:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319360 00000100:00100000:0.0:1788625552.140824:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319360 00000100:00100000:0.0:1788625552.140850:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788625552.140857:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206319360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788625552.140875:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788625552.140907:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206319360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.140914:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788625552.140925:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788625552.140943:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206319360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788625552.141435:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206319744:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206320256:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141625:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141649:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206320768:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141688:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788625552.141693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206319616:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141729:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206320128:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141745:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141758:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206320640:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625552.141798:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319616 00000100:00100000:1.0:1788625552.141803:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319616 00000100:00100000:1.0:1788625552.141829:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320128 00000100:00100000:1.0:1788625552.141831:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320128 00000100:00100000:1.0:1788625552.141843:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625552.141849:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141890:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206319616:12345-0@lo:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.141897:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788625552.141910:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788625552.141915:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206320128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.141935:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206320128:12345-0@lo:400:kworker.0 Request processed in 21us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.141941:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788625552.141957:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320256 00000100:00100000:0.0:1788625552.142231:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320768 00000100:00100000:0.0:1788625552.142234:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320768 00000100:00100000:0.0:1788625552.142281:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320640 00000100:00100000:0.0:1788625552.142283:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320640 00000100:00100000:0.0:1788625552.142297:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625552.142303:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.142334:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875509206320768:12345-0@lo:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.142340:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788625552.142350:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625552.142355:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.142374:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206320640:12345-0@lo:400:kworker.0 Request processed in 19us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.142379:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625552.142402:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99885eec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206319488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625552.142429:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.142449:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206320000:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.142481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.142496:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.142514:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625552.142696:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319744 00000100:00100000:3.0:1788625552.142701:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319744 00000100:00100000:3.0:1788625552.142733:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788625552.142739:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206319744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625552.142777:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206319744:12345-0@lo:400:kworker.0 Request processed in 39us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.142783:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788625552.143135:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320256 00000100:00100000:0.0:1788625552.143296:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788625552.143306:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206319872:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.143335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.143354:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.143377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625552.150324:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320000 00000100:00100000:2.0:1788625552.150348:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320000 00000100:00100000:2.0:1788625552.150430:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320512 00000100:00100000:2.0:1788625552.150434:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320512 00000100:00100000:2.0:1788625552.150463:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625552.150494:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206320256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.150640:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875509206320256:12345-0@lo:400:kworker.0 Request processed in 148us (9012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.150648:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788625552.150670:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625552.150677:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206320000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.150706:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875509206320000:12345-0@lo:400:kworker.0 Request processed in 30us (8224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.150713:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788625552.150724:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625552.150731:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206320512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.150761:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875509206320512:12345-0@lo:400:kworker.0 Request processed in 31us (8246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.150767:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625552.150802:0:24308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319488 00000100:00100000:2.0:1788625552.150806:0:24308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319488 00000100:00100000:2.0:1788625552.150849:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788625552.150856:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206319488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788625552.150875:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788625552.150912:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206319488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (8482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.150938:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788625552.150955:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625552.150960:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625552.150964:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625552.150967:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788625552.151007:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206319872 00000100:00100000:2.0:1788625552.151012:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206319872 00000100:00100000:2.0:1788625552.151039:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625552.151046:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206319872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.151078:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206319872:12345-0@lo:400:kworker.0 Request processed in 33us (7743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.151085:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788625552.151168:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206319616:0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.151187:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206320128:0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.151203:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.151219:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206319744:0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.151231:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875509206320256:0@lo:400:kworker.0 00010000:00080000:2.0:1788625552.151247:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743835180 x1875509206320768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625552.151259:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875509206320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.169804:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206320896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625552.169908:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.169994:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99885eec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206319488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788625552.170013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875509206320000:0@lo:400:kworker.0 00010000:00080000:0.0:1788625552.170031:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743837b80 x1875509206320512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788625552.170042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875509206320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788625552.170077:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206319872:0@lo:400:kworker.0 00000100:00100000:3.0:1788625552.170230:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320896 00000100:00100000:3.0:1788625552.170239:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320896 00000100:00100000:3.0:1788625552.170314:0:25591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788625552.170325:0:25591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206320896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788625552.170355:0:25591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788625552.170433:0:25591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875509206320896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.170441:0:25591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788625552.170676:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206320384 00000100:00100000:2.0:1788625552.170681:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206320384 00000100:00100000:2.0:1788625552.170739:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625552.170747:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206320384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625552.170804:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206320384:12345-0@lo:400:kworker.0 Request processed in 60us (27427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.170811:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788625552.173708:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206320384:0@lo:400:kworker.0 00000100:00100000:1.0:1788625552.173773:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875509206320896:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788625552.177673:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625552.465911:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625552.493313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625552.497471:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244288 00000100:00100000:1.0:1788625552.497494:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244288 00000100:00100000:1.0:1788625552.497669:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:1.0:1788625552.497681:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:18773:x1875509185244288:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625552.497708:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625552.497739:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e73d expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497825:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497845:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497864:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497883:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497890:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.497897:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498004:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41e00/0x2d2e3b3f34a7c326 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498035:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41e00/0x2d2e3b3f34a7c326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498042:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41e00/0x2d2e3b3f34a7c326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625552.498081:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788625552.498086:0:22800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625552.498134:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41e00/0x2d2e3b3f34a7c326 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498147:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498154:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498161:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498168:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625552.498172:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498180:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498195:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:1.0:1788625552.498198:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625552.498203:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498220:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498237:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498244:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498250:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498255:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625552.498258:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498264:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498272:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff998741f2b400) 00010000:00010000:1.0:1788625552.498275:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625552.498278:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498283:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c31f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498325:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e73d expref: 8 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498352:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41e00/0x2d2e3b3f34a7c326 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e73d expref: 7 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625552.498360:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998741f2bd00) 00010000:00010000:1.0:1788625552.498362:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625552.498365:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41e00, rc 0) 00000100:00100000:1.0:1788625552.498475:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18773:x1875509185244288:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 795us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.498484:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00080000:0.0:1788625552.498900:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788625552.511638:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.511756:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244416 00000100:00100000:0.0:1788625552.511771:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244416 00000100:00100000:0.0:1788625552.511843:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625552.511855:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18773:x1875509185244416:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788625552.511970:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18773:x1875509185244416:12345-192.168.204.14@tcp:900:lhsmtool_posix.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.511979:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:2.0:1788625552.518180:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.518310:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244672 00000100:00100000:0.0:1788625552.518324:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244672 00000100:00100000:0.0:1788625552.518400:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:0.0:1788625552.518412:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18773:x1875509185244672:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788625552.518439:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625552.518480:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c32d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e744 expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518671:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518689:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518703:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518722:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518729:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518735:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518878:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668200/0x2d2e3b3f34a7c342 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518886:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668200/0x2d2e3b3f34a7c342 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.518894:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668200/0x2d2e3b3f34a7c342 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625552.518905:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788625552.519103:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519119:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519126:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519132:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742669400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625552.519137:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519145:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519159:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998741f2bd00) 00010000:00010000:0.0:1788625552.519162:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625552.519168:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519174:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742669400/0x2d2e3b3f34a7c334 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519189:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519195:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519201:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519206:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625552.519215:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519221:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519231:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9988749c3f00) 00010000:00010000:0.0:1788625552.519234:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625552.519237:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.519243:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c33b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.524091:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c32d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e744 expref: 10 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.524127:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668200/0x2d2e3b3f34a7c342 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e744 expref: 9 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.524137:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3800) 00010000:00010000:0.0:1788625552.524140:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625552.524144:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998742668200, rc 0) 00000100:00100000:0.0:1788625552.524494:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18773:x1875509185244672:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 6081us (6326us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788625552.524506:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:1.0:1788625552.538801:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.538873:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244800 00000100:00100000:3.0:1788625552.538887:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244800 00000100:00100000:3.0:1788625552.538964:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:3.0:1788625552.538994:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18773:x1875509185244800:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788625552.539138:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18773:x1875509185244800:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.539145:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625552.552880:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.553253:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185244928 00000100:00100000:0.0:1788625552.553269:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185244928 00000100:00100000:0.0:1788625552.553378:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:0.0:1788625552.553390:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18773:x1875509185244928:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788625552.560292:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788625552.566130:0:22799:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 12647us 00000100:00100000:0.0:1788625552.580507:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.580651:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245056 00000100:00100000:2.0:1788625552.580665:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245056 00000100:00100000:2.0:1788625552.580738:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:2.0:1788625552.580750:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18779:x1875509185245056:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625552.580778:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625552.580805:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e74b expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.580891:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.580909:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.580923:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582863:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582891:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582925:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582978:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582986:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582994:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.582999:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625552.583004:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.583011:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.583025:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:2.0:1788625552.583028:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.583033:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.583040:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584188:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584201:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584219:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584224:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625552.584229:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584236:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584248:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff998743548b00) 00010000:00010000:2.0:1788625552.584251:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.584254:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584259:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c35e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584317:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c350 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e74b expref: 10 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.584330:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:2.0:1788625552.585096:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.585106:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e74b expref: 10 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.585119:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5e00, rc 0) 00000100:00100000:2.0:1788625552.585202:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18779:x1875509185245056:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 4453us (4708us total) trans 0 rc 301/301 00000100:00100000:2.0:1788625552.585223:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:3.0:1788625552.589968:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18773:x1875509185244928:12345-192.168.204.14@tcp:59:lhsmtool_posix.0 Request processed in 36565us (37087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.589985:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:1.0:1788625552.599978:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.600123:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245184 00000100:00100000:2.0:1788625552.600137:0:22808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245184 00000100:00100000:2.0:1788625552.600215:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:2.0:1788625552.600228:0:22808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18779:x1875509185245184:12345-192.168.204.14@tcp:700:lfs.0 00000100:00100000:2.0:1788625552.600352:0:22808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18779:x1875509185245184:12345-192.168.204.14@tcp:700:lfs.0 Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.600360:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625552.604168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.604314:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245440 00000100:00100000:0.0:1788625552.604328:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245440 00000100:00100000:0.0:1788625552.604402:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:0.0:1788625552.604414:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:18779:x1875509185245440:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:0.0:1788625552.604502:0:22801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625552.604566:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c27e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e6b8 expref: 9 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.604589:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:0.0:1788625552.604596:0:22801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788625552.604683:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.604700:0:22801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 5 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.604710:0:22801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.604753:0:22801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 5 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.604768:0:22801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 5 pid: 22801 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625552.604785:0:22801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9987439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22801:1875509206321024:192.168.204.14@tcp:104: 00000100:00100000:0.0:1788625552.604904:0:22801:0:(client.c:2716:ptlrpc_set_wait()) set ffff99887266b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788625552.608095:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.608193:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245568 00000100:00100000:2.0:1788625552.608265:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245568 00000100:00100000:0.0:1788625552.608429:0:22801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9987439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22801:1875509206321024:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625552.608475:0:22801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.608892:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 6 pid: 22801 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625552.608980:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625552.608991:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2393:x1875509185245568:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625552.609013:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625552.609022:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 6 pid: 22801 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609037:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 6 pid: 22801 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609066:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c2bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e728 expref: 6 pid: 22801 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609084:0:22784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:2.0:1788625552.609107:0:22784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609119:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609128:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.609172:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625552.609240:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2393:x1875509185245568:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 250us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.609249:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00010000:00010000:0.0:1788625552.609301:0:22801:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.609309:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.609340:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.609352:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.609360:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788625552.612408:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788625552.618137:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618245:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618262:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625552.618286:0:22801:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc45ff74 reply state 00000000c1e5a9c3 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618300:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618308:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:2.0:1788625552.618311:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625552.618317:0:22801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788625552.618325:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788625552.618354:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618363:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618371:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618378:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625552.618383:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618392:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618405:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9988606b3000) 00010000:00010000:2.0:1788625552.618407:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.618412:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618419:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c365 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788625552.618443:0:22801:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc45ff74 reply state 00000000c1e5a9c3 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618452:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.618471:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9988749c3f00) 00010000:00010000:2.0:1788625552.618474:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788625552.618483:0:22801:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788625552.619036:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99885eec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+10:18779:x1875509185245440:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 14615us (14875us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788625552.619049:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:1.0:1788625552.651771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206321152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625552.651803:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625552.651821:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99886cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206321280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788625552.651876:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625552.651971:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206321152 00000100:00100000:0.0:1788625552.651982:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206321152 00000100:00100000:0.0:1788625552.652048:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788625552.652058:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206321152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788625552.652112:0:22805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788625552.657300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625552.657470:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206321280 00000100:00100000:3.0:1788625552.657484:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206321280 00000100:00100000:3.0:1788625552.657573:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788625552.657586:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206321280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788625552.657641:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788625552.657752:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206321280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.657761:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788625552.657874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206321280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788625552.662434:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206321152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10364us (10544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625552.662452:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788625552.663873:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99886cbffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206321152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788625552.706014:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.706142:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245696 00000100:00100000:2.0:1788625552.706157:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245696 00000100:00100000:2.0:1788625552.706242:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:2.0:1788625552.706257:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+10:18787:x1875509185245696:12345-192.168.204.14@tcp:101:lctl.0 00010000:00010000:2.0:1788625552.706294:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625552.706327:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c37a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e752 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708479:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c381 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708511:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708659:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625552.708735:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625552.708757:0:22800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625552.708810:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c381 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708852:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c37a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e752 expref: 12 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708878:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683e00/0x2d2e3b3f34a7c381 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e752 expref: 11 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.708889:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:3.0:1788625552.708893:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625552.708897:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683e00, rc 0) 00000100:00100000:3.0:1788625552.708992:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+11:18787:x1875509185245696:12345-192.168.204.14@tcp:101:lctl.0 Request processed in 2737us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.709003:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 29 00000100:00100000:1.0:1788625552.745243:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.745350:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245824 00000100:00100000:3.0:1788625552.745364:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245824 00000100:00100000:3.0:1788625552.745445:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:3.0:1788625552.745467:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:18788:x1875509185245824:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625552.745496:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625552.745581:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e759 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745674:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7c38f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745704:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7c38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745743:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7c38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625552.745802:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625552.745806:0:24101:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625552.745830:0:24101:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7c38f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745861:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e759 expref: 7 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745883:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683800/0x2d2e3b3f34a7c38f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e759 expref: 6 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.745892:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:3.0:1788625552.745895:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625552.745899:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683800, rc 0) 00000100:00100000:3.0:1788625552.745968:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18788:x1875509185245824:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 514us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.745975:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 30 00000100:00100000:0.0:1788625552.754113:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.755409:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185245952 00000100:00100000:3.0:1788625552.755426:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185245952 00000100:00100000:3.0:1788625552.755514:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:3.0:1788625552.755554:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:18788:x1875509185245952:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625552.755582:0:22799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625552.755610:0:22799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e760 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755736:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755755:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755770:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755783:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755790:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755798:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755898:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755906:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.755914:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625552.755961:0:22799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625552.755965:0:22799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625552.755988:0:22799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756014:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756021:0:22799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756028:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756034:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625552.756038:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756046:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756061:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:3.0:1788625552.756064:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625552.756069:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756076:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756089:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756094:0:22799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756099:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756111:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625552.756114:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756120:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756128:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9988749c3f00) 00010000:00010000:3.0:1788625552.756130:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625552.756133:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756139:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756502:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e760 expref: 8 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756619:0:22799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e760 expref: 7 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.756628:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:3.0:1788625552.756630:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625552.756633:0:22799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682600, rc 0) 00000100:00100000:3.0:1788625552.756910:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+7:18788:x1875509185245952:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1357us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.756919:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 31 00000100:00100000:0.0:1788625552.761328:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.761445:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185246080 00000100:00100000:3.0:1788625552.761475:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185246080 00000100:00100000:3.0:1788625552.761765:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:3.0:1788625552.761777:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:18788:x1875509185246080:12345-192.168.204.14@tcp:900:lfs.0 00000100:00100000:3.0:1788625552.761888:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:18788:x1875509185246080:12345-192.168.204.14@tcp:900:lfs.0 Request processed in 113us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.761896:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:0.0:1788625552.768067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.768176:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185246336 00000100:00100000:3.0:1788625552.768190:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185246336 00000100:00100000:3.0:1788625552.768269:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00100000:3.0:1788625552.768282:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+7:18788:x1875509185246336:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625552.768309:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625552.768337:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e767 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625552.768489:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788625552.769445:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e767 expref: 9 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.769478:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:3.0:1788625552.769481:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788625552.769489:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e767 expref: 9 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.769508:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683000, rc 0) 00000100:00100000:3.0:1788625552.769619:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+8:18788:x1875509185246336:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1339us (1564us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788625552.769628:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 32 00000100:00080000:2.0:1788625552.770895:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788625552.773978:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.774077:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185246592 00000100:00100000:3.0:1788625552.774090:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185246592 00000100:00100000:3.0:1788625552.774174:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:3.0:1788625552.774187:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+8:18788:x1875509185246592:12345-192.168.204.14@tcp:36:lfs.0 00010000:00010000:3.0:1788625552.774263:0:22800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625552.774298:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e760 expref: 8 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.774323:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:3.0:1788625552.774329:0:22800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625552.774358:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.774375:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.774387:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625552.774733:0:22800:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9fd83d0 reply state 000000003d3d90d1 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.774750:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.774757:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:3.0:1788625552.774759:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788625552.774763:0:22800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788625552.774772:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788625552.774872:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+9:18788:x1875509185246592:12345-192.168.204.14@tcp:36:lfs.0 Request processed in 687us (907us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788625552.774891:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 33 00000100:00100000:0.0:1788625552.777895:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.778118:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185246848 00000100:00100000:3.0:1788625552.778132:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185246848 00000100:00100000:3.0:1788625552.778214:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:3.0:1788625552.778227:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+9:18788:x1875509185246848:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625552.780358:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+10:18788:x1875509185246848:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 2116us (2460us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788625552.780383:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:2.0:1788625552.783785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.783945:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247104 00000100:00100000:0.0:1788625552.783958:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247104 00000100:00100000:0.0:1788625552.784036:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:0.0:1788625552.784048:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+10:18788:x1875509185247104:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:0.0:1788625552.784080:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788625552.784110:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742669800/0x2d2e3b3f34a7c3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e76e expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784227:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784246:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784262:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784278:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784286:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784293:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625552.784447:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788625552.784626:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784658:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784666:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784673:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625552.784678:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784756:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784774:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:0.0:1788625552.784777:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625552.784783:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784790:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668e00/0x2d2e3b3f34a7c3ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784806:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784812:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784818:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784823:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1788625552.784833:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784840:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784848:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9988749c3f00) 00010000:00010000:0.0:1788625552.784851:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788625552.784855:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784861:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668a00/0x2d2e3b3f34a7c3d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784908:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998742669800/0x2d2e3b3f34a7c3c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e76e expref: 12 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784919:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:0.0:1788625552.784922:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788625552.784926:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742669800/0x2d2e3b3f34a7c3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e76e expref: 12 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625552.784937:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998742669800, rc 0) 00000100:00100000:0.0:1788625552.785017:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+11:18788:x1875509185247104:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 970us (1244us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788625552.785026:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 34 00000100:00100000:1.0:1788625552.792825:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.796635:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247232 00000100:00100000:3.0:1788625552.796658:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247232 00000100:00100000:3.0:1788625552.796778:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:3.0:1788625552.796791:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+11:18788:x1875509185247232:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625552.796830:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625552.796860:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3e3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e775 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797031:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797050:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797064:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625552.797096:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788625552.797100:0:22800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625552.797126:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797834:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c3e3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 13 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797878:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 12 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625552.797888:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:3.0:1788625552.797891:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788625552.797896:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683000, rc 0) 00000100:00100000:3.0:1788625552.797995:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:18788:x1875509185247232:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1207us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625552.798004:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 35 00000100:00100000:1.0:1788625552.823284:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625552.823489:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247360 00000100:00100000:0.0:1788625552.823503:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247360 00000100:00100000:0.0:1788625552.823628:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:0.0:1788625552.823642:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:18788:x1875509185247360:12345-192.168.204.14@tcp:37:lfs.0 00000100:00100000:1.0:1788625552.839841:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:18788:x1875509185247360:12345-192.168.204.14@tcp:37:lfs.0 Request processed in 16185us (16556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625552.839865:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:1.0:1788625552.870938:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.871087:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247616 00000100:00100000:2.0:1788625552.871101:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247616 00000100:00100000:2.0:1788625552.871178:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 4 00000100:00100000:2.0:1788625552.871191:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884419e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:18788:x1875509185247616:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625552.871569:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884419e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e10baa21-d455-4ab1-8b08-cff99c0f467e+13:18788:x1875509185247616:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 327us (593us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788625552.871589:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 4 00000040:00080000:0.0:1788625552.909039:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625552.985933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625552.986887:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247744 00000100:00100000:2.0:1788625552.986903:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247744 00000100:00100000:2.0:1788625552.986996:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:2.0:1788625552.987010:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+11:18794:x1875509185247744:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625552.987039:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625552.987067:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c3f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e77c expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993048:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993083:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993103:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993117:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993124:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993132:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993561:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c406 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993589:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c406 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993669:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c406 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625552.993721:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788625552.993726:0:22801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625552.993778:0:22801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c406 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993794:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993802:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993809:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993816:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625552.993822:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993831:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993849:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:2.0:1788625552.993853:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.993860:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993878:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c3f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993897:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993904:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993910:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993915:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625552.993918:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993924:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993931:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9988749c3f00) 00010000:00010000:2.0:1788625552.993934:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625552.993937:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993942:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c3ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.993992:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c3f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e77c expref: 13 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.994025:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4800/0x2d2e3b3f34a7c406 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e77c expref: 12 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625552.994033:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:2.0:1788625552.994036:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788625552.994038:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4800, rc 0) 00000100:00100000:2.0:1788625552.994774:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+12:18794:x1875509185247744:12345-192.168.204.14@tcp:101:bash.0 Request processed in 7762us (8851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625552.994786:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 36 00000100:00100000:0.0:1788625552.999137:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625552.999910:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185247872 00000100:00100000:3.0:1788625552.999925:0:22810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185247872 00000100:00100000:3.0:1788625553.000011:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:3.0:1788625553.000024:0:22810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18794:x1875509185247872:12345-192.168.204.14@tcp:900:bash.0 00000100:00100000:3.0:1788625553.001031:0:22810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:18794:x1875509185247872:12345-192.168.204.14@tcp:900:bash.0 Request processed in 1006us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625553.001042:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:1.0:1788625553.004149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625553.004274:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185248128 00000100:00100000:3.0:1788625553.004289:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185248128 00000100:00100000:3.0:1788625553.004362:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:3.0:1788625553.004373:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+12:18794:x1875509185248128:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625553.004400:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625553.004429:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c40d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e783 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.004667:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.004703:0:22800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 12 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.004713:0:22800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.004769:0:22800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 12 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.004786:0:22800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 12 pid: 22800 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625553.004802:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321408:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625553.004916:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512cb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788625553.010105:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321408:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625553.010163:0:22800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625553.017316:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625553.017622:0:23551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185248256 00000100:00100000:0.0:1788625553.017636:0:23551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185248256 00010000:00010000:0.0:1788625553.017705:0:23551:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 13 pid: 22800 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625553.017756:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:0.0:1788625553.017781:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+13:2394:x1875509185248256:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625553.017801:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625553.017809:0:23551:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 13 pid: 22800 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017824:0:23551:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 13 pid: 22800 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017861:0:23551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683000/0x2d2e3b3f34a7c3ea lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e775 expref: 13 pid: 22800 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017883:0:23551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:0.0:1788625553.017890:0:23551:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017903:0:23551:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017912:0:23551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625553.017970:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625553.018057:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:2394:x1875509185248256:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 291us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625553.018064:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00010000:00010000:3.0:1788625553.019310:0:22800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.019326:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.023760:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.023790:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.023820:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.024905:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.024920:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.024929:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625553.024941:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788625553.024978:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025339:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025346:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025352:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1788625553.025357:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025365:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025378:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:3.0:1788625553.025382:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788625553.025396:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025402:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c414 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788625553.025416:0:22800:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089bece64 reply state 0000000075c24087 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025427:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025433:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99885129c300) 00010000:00010000:3.0:1788625553.025436:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788625553.025439:0:22800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788625553.025488:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c40d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 15 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025503:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 14 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.025510:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625553.025513:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788625553.025602:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682a00, rc 0) 00000100:00100000:3.0:1788625553.025678:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:18794:x1875509185248128:12345-192.168.204.14@tcp:101:bash.0 Request processed in 21305us (21551us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788625553.025687:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 37 00000100:00100000:1.0:1788625553.053188:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625553.053349:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185248384 00000100:00100000:3.0:1788625553.053363:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185248384 00000100:00100000:3.0:1788625553.053445:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:3.0:1788625553.053467:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:18794:x1875509185248384:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625553.053560:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625553.053588:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c430 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e78a expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053695:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053712:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053727:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625553.053805:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788625553.053811:0:24101:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788625553.053838:0:24101:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053851:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053883:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c430 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e78a expref: 17 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053906:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e78a expref: 16 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.053916:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625553.053920:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625553.053924:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682800, rc 0) 00000100:00100000:3.0:1788625553.054006:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+16:18794:x1875509185248384:12345-192.168.204.14@tcp:101:bash.0 Request processed in 542us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625553.054014:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 38 00000100:00100000:1.0:1788625553.075668:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.079127:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185248640 00000100:00100000:2.0:1788625553.079150:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185248640 00000100:00100000:2.0:1788625553.079256:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:2.0:1788625553.079270:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+16:18794:x1875509185248640:12345-192.168.204.14@tcp:35:bash.0 00000100:00100000:2.0:1788625553.079810:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+17:18794:x1875509185248640:12345-192.168.204.14@tcp:35:bash.0 Request processed in 541us (4155us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788625553.079820:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 5 00000100:00100000:0.0:1788625553.254045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.265897:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185248896 00000100:00100000:1.0:1788625553.265921:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185248896 00000100:00100000:1.0:1788625553.266029:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:1.0:1788625553.266042:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+17:18804:x1875509185248896:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625553.266076:0:22799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625553.266103:0:22799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c43e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e791 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625553.266254:0:22799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788625553.266426:0:22799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c43e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e791 expref: 19 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.266452:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:1.0:1788625553.266456:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625553.266463:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c43e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e791 expref: 19 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.266480:0:22799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41400, rc 0) 00000100:00100000:1.0:1788625553.266990:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18804:x1875509185248896:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 947us (13328us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788625553.266998:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 39 00000100:00100000:0.0:1788625553.301333:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.302211:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185249152 00000100:00100000:2.0:1788625553.302244:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185249152 00000100:00100000:2.0:1788625553.302327:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625553.302339:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18804:x1875509185249152:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625553.303079:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+19:18804:x1875509185249152:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 735us (1755us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788625553.303090:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 6 00000100:00100000:2.0:1788625553.386809:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625553.387018:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185249408 00000100:00100000:3.0:1788625553.387029:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185249408 00000100:00100000:3.0:1788625553.387091:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:3.0:1788625553.387102:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+19:18807:x1875509185249408:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:3.0:1788625553.387130:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625553.387221:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c44c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e798 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.387335:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7c453 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.387349:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7c453 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.387361:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7c453 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788625553.387371:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788625553.387485:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c44c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e798 expref: 22 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.387801:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7c453 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e798 expref: 21 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625553.387813:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625553.387816:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788625553.387830:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683400, rc 0) 00000100:00100000:0.0:1788625553.388022:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:18807:x1875509185249408:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 920us (1220us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788625553.388030:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 40 00000100:00100000:0.0:1788625553.393091:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625553.393139:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.393290:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185249536 00000100:00100000:2.0:1788625553.393302:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185249536 00000100:00100000:2.0:1788625553.393371:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:2.0:1788625553.393382:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:2393:x1875509185249536:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625553.393399:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625553.393425:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683400/0x2d2e3b3f34a7c453 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e798 expref: 21 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.393456:0:22785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625553.393462:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625553.393555:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:2393:x1875509185249536:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 175us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625553.393563:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:1.0:1788625553.394100:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185249664 00000100:00100000:1.0:1788625553.394106:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185249664 00000100:00100000:1.0:1788625553.394150:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:1.0:1788625553.394175:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18807:x1875509185249664:12345-192.168.204.14@tcp:54:lfs.0 00010000:00010000:1.0:1788625553.394232:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394247:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394257:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394290:0:22799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394298:0:22799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394303:0:22799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394308:0:22799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625553.394312:0:22799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394319:0:22799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394327:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625553.394329:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625553.394332:0:22799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625553.394338:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c461 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625553.394393:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18807:x1875509185249664:12345-192.168.204.14@tcp:54:lfs.0 Request processed in 219us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625553.394401:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 41 00000100:00100000:0.0:1788625553.409008:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.412677:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185249920 00000100:00100000:2.0:1788625553.412693:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185249920 00000100:00100000:2.0:1788625553.412779:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 7 00000100:00100000:2.0:1788625553.412789:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18807:x1875509185249920:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625553.413022:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:18807:x1875509185249920:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 234us (4024us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788625553.413031:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 7 00010000:00010000:3.0:1788625553.487042:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788625553.548252:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625553.821325:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.821465:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250176 00000100:00100000:2.0:1788625553.821479:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250176 00000100:00100000:2.0:1788625553.821582:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:2.0:1788625553.821593:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:18838:x1875509185250176:12345-192.168.204.14@tcp:101:cat.0 00010000:00010000:2.0:1788625553.821625:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625553.821651:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c468 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e79f expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.822203:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c46f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.822221:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c46f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.822234:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c46f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625553.822246:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788625553.822604:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c468 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e79f expref: 24 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.822629:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c46f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e79f expref: 23 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.822638:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625553.822641:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625553.822646:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:2.0:1788625553.823248:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+23:18838:x1875509185250176:12345-192.168.204.14@tcp:101:cat.0 Request processed in 1653us (1934us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788625553.823257:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 42 00000100:00100000:0.0:1788625553.839680:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.839886:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250432 00000100:00100000:2.0:1788625553.839901:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250432 00000100:00100000:2.0:1788625553.839974:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 8 00000100:00100000:2.0:1788625553.839987:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+23:18838:x1875509185250432:12345-192.168.204.14@tcp:35:cat.0 00000001:00080000:2.0:1788625553.840303:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901903 00000100:00100000:2.0:1788625553.840464:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:18838:x1875509185250432:12345-192.168.204.14@tcp:35:cat.0 Request processed in 480us (811us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788625553.840474:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 8 00000020:00080000:2.0:1788625553.840479:0:22803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788625553.845808:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625553.845939:0:23551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250560 00000100:00100000:2.0:1788625553.845952:0:23551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250560 00000100:00100000:2.0:1788625553.846042:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:2.0:1788625553.846055:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:2392:x1875509185250560:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625553.846076:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625553.846240:0:23551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c46f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e79f expref: 25 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625553.846267:0:23551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625553.846273:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625553.846349:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+24:2392:x1875509185250560:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 296us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625553.846358:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 1 00000100:00100000:0.0:1788625553.931419:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625553.931484:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.931874:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250688 00000100:00100000:1.0:1788625553.931889:0:22792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250688 00000100:00100000:1.0:1788625553.931952:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 162 00000100:00100000:1.0:1788625553.931963:0:22792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2394:x1875509185250688:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625553.932059:0:22792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2394:x1875509185250688:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 98us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625553.932069:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 162 00000100:00100000:1.0:1788625553.932151:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.932178:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251200 00000100:00100000:1.0:1788625553.932182:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251200 00000100:00100000:1.0:1788625553.932214:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625553.932221:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:2394:x1875509185251200:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625553.932261:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+12:2394:x1875509185251200:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625553.932267:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:1.0:1788625553.932345:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.932457:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.932478:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.932500:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000040:00080000:0.0:1788625553.933223:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625553.933317:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250816 00000100:00100000:0.0:1788625553.933324:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250816 00000100:00100000:0.0:1788625553.933362:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251328 00000100:00100000:0.0:1788625553.933365:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251328 00000100:00100000:0.0:1788625553.933383:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:0.0:1788625553.933391:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185250816:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625553.934011:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185250944 00000100:00100000:2.0:1788625553.934017:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185250944 00000100:00100000:2.0:1788625553.934067:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251456 00000100:00100000:2.0:1788625553.934071:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251456 00000100:00100000:2.0:1788625553.934089:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251072 00000100:00100000:2.0:1788625553.934093:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251072 00000100:00100000:2.0:1788625553.934111:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625553.934119:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185250944:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:3.0:1788625553.934287:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:3.0:1788625553.934298:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251456:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625553.935358:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185250816:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 1960us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625553.935391:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:0.0:1788625553.935426:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:0.0:1788625553.935448:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251328:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625553.946985:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625553.949799:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251584 00000100:00100000:1.0:1788625553.949844:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251584 00000100:00100000:1.0:1788625553.949926:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:1.0:1788625553.949939:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185251072:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625553.950070:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185251072:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 134us (17590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625553.950077:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:2.0:1788625553.950562:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2394:x1875509185250944:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 16441us (19075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625553.950573:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625553.950606:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:2.0:1788625553.950614:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251584:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625553.950658:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251584:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 45us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625553.950664:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00080000:2.0:1788625553.950848:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625553.950853:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788625553.963567:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251456:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 29252us (31202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625553.963587:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 16 00000100:00100000:0.0:1788625553.967496:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2394:x1875509185251328:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 32044us (34982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625553.967515:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625554.007933:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625554.008046:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251840 00000100:00100000:1.0:1788625554.008059:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251840 00000100:00100000:1.0:1788625554.008155:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:1.0:1788625554.008169:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+24:18844:x1875509185251840:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:1.0:1788625554.008201:0:22799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625554.008228:0:22799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c47d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7a6 expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.008489:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.008964:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.008981:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625554.008997:0:22799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00080000:2.0:1788625554.009218:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788625554.009450:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c47d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 27 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.009475:0:22799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 26 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.010328:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625554.010332:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625554.010337:0:22799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41600, rc 0) 00000100:00100000:1.0:1788625554.010442:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+26:18844:x1875509185251840:12345-192.168.204.14@tcp:101:dd.0 Request processed in 2266us (2512us total) trans 12884901905 rc 0/0 00000100:00100000:1.0:1788625554.010452:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 43 00000100:00100000:1.0:1788625554.018977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625554.019089:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185251968 00000100:00100000:2.0:1788625554.019102:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185251968 00000100:00100000:2.0:1788625554.019192:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625554.019205:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+26:18844:x1875509185251968:12345-192.168.204.14@tcp:101:dd.0 00010000:00010000:2.0:1788625554.019241:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625554.019273:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c492 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7ad expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019334:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019353:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019368:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019577:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c492 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 28 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019613:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 27 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.019623:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625554.019627:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625554.019632:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e4200, rc 0) 00000100:00100000:2.0:1788625554.019924:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+27:18844:x1875509185251968:12345-192.168.204.14@tcp:101:dd.0 Request processed in 720us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625554.019932:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 44 00000100:00100000:2.0:1788625554.028283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625554.028636:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185252224 00000100:00100000:3.0:1788625554.028647:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185252224 00000100:00100000:3.0:1788625554.028723:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 45 00000100:00100000:3.0:1788625554.028736:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+27:18844:x1875509185252224:12345-192.168.204.14@tcp:36:dd.0 00010000:00010000:3.0:1788625554.028808:0:22800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625554.028845:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c437 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e78a expref: 27 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625554.028868:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625554.028874:0:22800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788625554.029094:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625554.029112:0:22800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 27 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625554.029133:0:22800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625554.029174:0:22800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 27 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625554.029213:0:22800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 27 pid: 22799 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625554.029228:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321536:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625554.029352:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788625554.034365:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321536:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625554.034410:0:22800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625554.038927:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625554.039841:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185252352 00000100:00100000:2.0:1788625554.039857:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185252352 00010000:00010000:2.0:1788625554.039916:0:22785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 28 pid: 22799 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625554.039964:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 17 00000100:00100000:2.0:1788625554.039976:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+28:2394:x1875509185252352:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788625554.039996:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788625554.040004:0:22785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 28 pid: 22799 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040021:0:22785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 28 pid: 22799 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040047:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c484 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7a6 expref: 28 pid: 22799 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040089:0:22785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625554.040095:0:22785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040107:0:22785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040116:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.040173:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788625554.040244:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+27:2394:x1875509185252352:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 270us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625554.040251:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 17 00010000:00010000:0.0:1788625554.044440:0:22800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625554.044463:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625554.046764:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625554.046853:0:23551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185252480 00000100:00100000:0.0:1788625554.046866:0:23551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185252480 00000100:00100000:0.0:1788625554.046954:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 2 00000100:00100000:0.0:1788625554.046965:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+27:2393:x1875509185252480:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625554.046987:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625554.046990:0:23551:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 2d2e3b3f34a7c484) 00010000:00010000:0.0:1788625554.046992:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625554.047059:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+27:2393:x1875509185252480:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 96us (309us total) trans 0 rc 116/116 00000100:00100000:0.0:1788625554.047066:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 2 00000001:00080000:1.0:1788625554.052935:0:22800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:1.0:1788625554.053043:0:22800:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b87de9a6 reply state 000000004d014d41 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.053075:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.053087:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625554.053090:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625554.053095:0:22800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625554.053565:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+28:18844:x1875509185252224:12345-192.168.204.14@tcp:36:dd.0 Request processed in 24825us (25292us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788625554.053577:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 45 00000020:00080000:1.0:1788625554.053584:0:22800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788625554.180949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625554.181364:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185252736 00000100:00100000:0.0:1788625554.181379:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185252736 00000100:00100000:0.0:1788625554.181480:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 9 00000100:00100000:0.0:1788625554.181691:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+28:18844:x1875509185252736:12345-192.168.204.14@tcp:35:dd.0 00000100:00100000:0.0:1788625554.182397:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+29:18844:x1875509185252736:12345-192.168.204.14@tcp:35:dd.0 Request processed in 904us (1461us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788625554.182408:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 9 00010000:00010000:2.0:1788625554.507860:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788625554.645104:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625554.645448:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185252864 00000100:00100000:1.0:1788625554.645462:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185252864 00000100:00100000:1.0:1788625554.645609:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:1.0:1788625554.645622:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+29:18857:x1875509185252864:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:1.0:1788625554.646693:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625554.646731:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7b4 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647025:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647044:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647059:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647072:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647080:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647086:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647223:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647233:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647240:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625554.647300:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788625554.647305:0:24101:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625554.647359:0:24101:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647389:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647400:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647407:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647413:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647433:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625554.647438:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647446:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647460:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:1.0:1788625554.647464:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625554.647469:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647476:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c4ae lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647503:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.647509:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648279:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648286:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625554.648289:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648297:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648321:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99885129c300) 00010000:00010000:1.0:1788625554.648323:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625554.648328:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648334:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4b5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648382:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7b4 expref: 31 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648399:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7b4 expref: 30 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.648406:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625554.648409:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625554.648412:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40600, rc 0) 00000100:00100000:1.0:1788625554.648571:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+30:18857:x1875509185252864:12345-192.168.204.14@tcp:101:stat.0 Request processed in 2950us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625554.648596:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 46 00000100:00100000:3.0:1788625554.709903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625554.713935:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185253120 00000100:00100000:1.0:1788625554.713958:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185253120 00000100:00100000:1.0:1788625554.718707:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 47 00000100:00100000:1.0:1788625554.718746:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+30:18864:x1875509185253120:12345-192.168.204.14@tcp:36:truncate.0 00010000:00010000:1.0:1788625554.718846:0:22799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625554.718884:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7b4 expref: 30 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.718911:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625554.718917:0:22799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625554.719158:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.719176:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.719188:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625554.719240:0:22799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901909 00000004:00010000:1.0:1788625554.719266:0:22799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035e2d271 reply state 0000000006b060c2 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.719280:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625554.719286:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625554.719288:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625554.719308:0:22799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625554.719473:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+32:18864:x1875509185253120:12345-192.168.204.14@tcp:36:truncate.0 Request processed in 748us (9585us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788625554.719481:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 47 00000020:00080000:1.0:1788625554.719487:0:22799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788625554.907313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625554.909136:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185253248 00000100:00100000:2.0:1788625554.909155:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185253248 00000100:00100000:2.0:1788625554.909429:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:2.0:1788625554.909443:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+32:18878:x1875509185253248:12345-192.168.204.14@tcp:101:stat.0 00010000:00010000:2.0:1788625554.909479:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625554.909508:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c4ca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7bb expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909621:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909661:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909680:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909694:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909702:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909708:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909808:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909817:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909825:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625554.909878:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788625554.909884:0:22801:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788625554.909932:0:22801:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909948:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909967:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909975:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909983:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.909989:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625554.909994:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910003:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910017:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:2.0:1788625554.910020:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625554.910026:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910034:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c4d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910063:0:22801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910070:0:22801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910077:0:22801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910087:0:22801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625554.910091:0:22801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910098:0:22801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910107:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99885129c300) 00010000:00010000:2.0:1788625554.910109:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625554.910112:0:22801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910119:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c4d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910152:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c4ca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 34 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910170:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 33 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625554.910178:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625554.910180:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788625554.910183:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21a00, rc 0) 00000100:00100000:2.0:1788625554.910361:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+33:18878:x1875509185253248:12345-192.168.204.14@tcp:101:stat.0 Request processed in 919us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625554.910369:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 48 00000100:00100000:3.0:1788625555.073287:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.073461:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185253504 00000100:00100000:1.0:1788625555.073631:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185253504 00000100:00100000:1.0:1788625555.073721:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:1.0:1788625555.073735:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+33:18888:x1875509185253504:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:1.0:1788625555.073767:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625555.073795:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7c2 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625555.073939:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788625555.074916:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c2 expref: 35 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.074940:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:1.0:1788625555.074943:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625555.074950:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c2 expref: 35 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.074970:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40600, rc 0) 00000100:00100000:1.0:1788625555.075081:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+34:18888:x1875509185253504:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 1348us (1811us total) trans 12884901911 rc 301/301 00000100:00100000:1.0:1788625555.075091:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 49 00000100:00100000:3.0:1788625555.080948:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625555.081086:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185253760 00000100:00100000:0.0:1788625555.081113:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185253760 00000100:00100000:0.0:1788625555.081231:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:0.0:1788625555.081243:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884419ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+34:18888:x1875509185253760:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:0.0:1788625555.081625:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884419ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+35:18888:x1875509185253760:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 383us (691us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788625555.081634:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 10 00000100:00100000:3.0:1788625555.157811:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.158459:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254016 00000100:00100000:1.0:1788625555.158484:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254016 00000100:00100000:1.0:1788625555.158705:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:1.0:1788625555.158717:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+35:18894:x1875509185254016:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625555.158749:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625555.158779:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4f4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7c9 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.158950:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.158969:0:24101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.158978:0:24101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 36 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.158988:0:24101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.159031:0:24101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 36 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.159047:0:24101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 36 pid: 22801 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625555.159062:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206321664:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625555.159202:0:24101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.159223:0:24101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625555.161418:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206321792:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625555.161923:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625555.170834:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625555.170887:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.173126:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206321664:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625555.173150:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206321792:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625555.173210:0:24101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625555.178504:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254144 00000100:00100000:0.0:1788625555.178541:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254144 00010000:00010000:0.0:1788625555.178614:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 37 pid: 22801 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625555.178749:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254272 00000100:00100000:0.0:1788625555.178754:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254272 00010000:00010000:0.0:1788625555.178770:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 38 pid: 22800 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625555.178806:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:0.0:1788625555.178817:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:2394:x1875509185254144:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625555.178835:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625555.178843:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 38 pid: 22801 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.178882:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 38 pid: 22801 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.178920:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c4df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7bb expref: 38 pid: 22801 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.178944:0:22784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:0.0:1788625555.178951:0:22784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.178961:0:22784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.178969:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625555.179050:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+37:2394:x1875509185254144:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 235us (8232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625555.179059:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 18 00000100:00100000:0.0:1788625555.179077:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:0.0:1788625555.179105:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+36:2394:x1875509185254272:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625555.179114:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625555.179119:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179130:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179161:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682a00/0x2d2e3b3f34a7c422 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e783 expref: 36 pid: 22800 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179173:0:22784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:0.0:1788625555.179177:0:22784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179187:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179196:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179224:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788625555.179241:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+35:2394:x1875509185254272:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 142us (8354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625555.179248:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00010000:00010000:0.0:1788625555.179511:0:24101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.179562:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788625555.179586:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788625555.180497:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c4f4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 36 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.180554:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 35 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.180565:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625555.180568:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788625555.180572:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40a00, rc 0) 00000100:00100000:1.0:1788625555.180648:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+35:18894:x1875509185254016:12345-192.168.204.14@tcp:101:bash.0 Request processed in 21933us (22852us total) trans 12884901913 rc 0/0 00000100:00100000:1.0:1788625555.180656:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 50 00000100:00100000:3.0:1788625555.183617:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.183873:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254528 00000100:00100000:1.0:1788625555.183895:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254528 00000100:00100000:1.0:1788625555.183976:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 51 00000100:00100000:1.0:1788625555.184007:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+35:18894:x1875509185254528:12345-192.168.204.14@tcp:36:bash.0 00010000:00010000:1.0:1788625555.184335:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.184358:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.184373:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625555.184439:0:22799:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000004:00010000:1.0:1788625555.184465:0:22799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d258179c reply state 000000005c1a0993 transno 12884901915 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.184479:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.184488:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625555.184491:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625555.184496:0:22799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625555.186733:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18894:x1875509185254528:12345-192.168.204.14@tcp:36:bash.0 Request processed in 2712us (3111us total) trans 12884901915 rc 0/0 00000100:00100000:1.0:1788625555.186748:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 51 00000020:00080000:1.0:1788625555.186757:0:22799:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788625555.194336:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625555.194875:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254656 00000100:00100000:2.0:1788625555.194907:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254656 00000100:00100000:2.0:1788625555.194988:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:2.0:1788625555.195000:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18894:x1875509185254656:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625555.195031:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625555.195060:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7c510 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7d0 expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625555.195140:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7c510 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d0 expref: 39 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625555.195165:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7c510 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d0 expref: 39 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625555.195186:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625555.195190:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625555.195194:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20800, rc 0) 00000100:00100000:2.0:1788625555.195287:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18894:x1875509185254656:12345-192.168.204.14@tcp:101:bash.0 Request processed in 288us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625555.195295:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 52 00000100:00100000:0.0:1788625555.205820:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625555.206027:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254784 00000100:00100000:3.0:1788625555.206043:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254784 00000100:00100000:3.0:1788625555.206123:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:3.0:1788625555.206135:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18894:x1875509185254784:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625555.206175:0:22800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625555.206203:0:22800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c517 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7d7 expref: -99 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.206343:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.206363:0:22800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 40 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.206373:0:22800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.206429:0:22800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 40 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.206445:0:22800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 40 pid: 24101 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625555.206461:0:22800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743837480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321920:192.168.204.14@tcp:104: 00000100:00100000:3.0:1788625555.206631:0:22800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512cba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788625555.214498:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625555.214799:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185254912 00000100:00100000:3.0:1788625555.214813:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185254912 00010000:00010000:3.0:1788625555.214880:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 41 pid: 24101 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625555.214944:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:3.0:1788625555.214956:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:2393:x1875509185254912:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625555.214980:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625555.214988:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 41 pid: 24101 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.215025:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 41 pid: 24101 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.215304:0:22784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625555.215311:0:22784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.215325:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.215334:0:22784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.215360:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625555.215433:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:2393:x1875509185254912:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 478us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625555.215442:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00010000:00010000:1.0:1788625555.217025:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c4fb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7c9 expref: 40 pid: 24101 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625555.217287:0:22800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743837480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22800:1875509206321920:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625555.217320:0:22800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.217355:0:22800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.217361:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625555.217447:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788625555.217453:0:22800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625555.217703:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.217750:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682800/0x2d2e3b3f34a7c517 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d7 expref: 40 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.217770:0:22800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d7 expref: 39 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.217779:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625555.217783:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625555.217787:0:22800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b683c00, rc 0) 00000100:00100000:1.0:1788625555.217879:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18894:x1875509185254784:12345-192.168.204.14@tcp:101:bash.0 Request processed in 11746us (12074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625555.217889:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 53 00000100:00100000:0.0:1788625555.223711:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625555.223856:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255168 00000100:00100000:3.0:1788625555.223869:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255168 00000100:00100000:3.0:1788625555.223958:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:3.0:1788625555.223971:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18894:x1875509185255168:12345-192.168.204.14@tcp:103:bash.0 00010000:00010000:3.0:1788625555.223991:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788625555.224026:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da20800/0x2d2e3b3f34a7c510 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d0 expref: 39 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.224051:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683c00/0x2d2e3b3f34a7c51e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7d7 expref: 38 pid: 22800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625555.224091:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:3.0:1788625555.224097:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625555.224188:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+37:18894:x1875509185255168:12345-192.168.204.14@tcp:103:bash.0 Request processed in 219us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625555.224196:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 3 00000100:00100000:2.0:1788625555.226950:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625555.227147:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255296 00000100:00100000:0.0:1788625555.227160:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255296 00000100:00100000:0.0:1788625555.227253:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:0.0:1788625555.227265:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+37:18894:x1875509185255296:12345-192.168.204.14@tcp:58:bash.0 00010000:00010000:0.0:1788625555.227421:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.227444:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625555.227458:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788625555.229291:0:22801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788625555.229333:0:22801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788625555.229668:0:22801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788625555.229850:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886cbfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+37:18894:x1875509185255296:12345-192.168.204.14@tcp:58:bash.0 Request processed in 2578us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625555.229864:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 54 00000100:00100000:0.0:1788625555.234839:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.237962:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255424 00000100:00100000:1.0:1788625555.237985:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255424 00000100:00100000:1.0:1788625555.238168:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 55 00000100:00100000:1.0:1788625555.238182:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+37:18894:x1875509185255424:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:1.0:1788625555.238212:0:22799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625555.238265:0:22799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7de expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238344:0:22799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238358:0:22799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 38 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238385:0:22799:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238401:0:22799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 38 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238431:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625555.238434:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625555.238439:0:22799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 38 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.238448:0:22799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40a00, rc 0) 00000100:00100000:1.0:1788625555.238580:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18894:x1875509185255424:12345-192.168.204.14@tcp:101:bash.0 Request processed in 401us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625555.238588:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 55 00010000:00010000:2.0:1788625555.534330:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625555.980073:0:22832:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788625555.980097:0:22832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788625555.980171:0:22832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788625555.980183:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788625555.980373:0:22832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22832:1875509206322048:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788625555.980513:0:22832:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742dd7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625555.984207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.984749:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255552 00000100:00100000:1.0:1788625555.984763:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255552 00000100:00100000:1.0:1788625555.984838:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:1.0:1788625555.984851:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185255552:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788625555.984896:0:24101:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788625555.985070:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185255552:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 221us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625555.985080:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 56 00000100:00100000:2.0:1788625555.987488:0:22832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99874422bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22832:1875509206322048:192.168.204.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788625555.991927:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625555.992148:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255680 00000100:00100000:1.0:1788625555.992162:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255680 00000100:00100000:1.0:1788625555.992263:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:1.0:1788625555.992285:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18895:x1875509185255680:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788625555.992420:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.992443:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.992467:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998315:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998470:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998485:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998535:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998546:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998553:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625555.998626:0:22800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788625555.998631:0:22800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625555.998646:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998659:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998666:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998673:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998678:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625555.998682:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998689:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998701:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3800) 00010000:00010000:1.0:1788625555.998704:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625555.998708:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625555.998714:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c533 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000353:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000449:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000458:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000464:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.000468:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000476:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000488:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff998741f2b400) 00010000:00010000:1.0:1788625556.000491:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.000495:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000514:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c53a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000898:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.000905:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.001197:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.001203:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.001213:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.001220:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.001231:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.001234:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.001237:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.001242:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c541 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.001399:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18895:x1875509185255680:12345-192.168.204.14@tcp:34:lhsmtool_posix.0 Request processed in 9111us (9472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.001410:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 57 00000100:00100000:3.0:1788625556.005602:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.005751:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185255936 00000100:00100000:1.0:1788625556.005768:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185255936 00000100:00100000:1.0:1788625556.005882:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00100000:1.0:1788625556.005894:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+38:18895:x1875509185255936:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.005915:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625556.005941:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c548 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7e5 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006064:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006080:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006109:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625556.006121:0:24101:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788625556.006201:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006208:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006214:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006220:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.006224:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006232:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006244:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.006247:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788625556.006252:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006257:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c54f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006307:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c548 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7e5 expref: 40 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006329:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9988749c3800) 00010000:00010000:1.0:1788625556.006332:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788625556.006336:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c548 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7e5 expref: 40 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.006346:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41400, rc 0) 00000100:00100000:1.0:1788625556.006424:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185255936:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 533us (838us total) trans 12884901916 rc 301/301 00000100:00100000:1.0:1788625556.006431:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 58 00000100:00080000:2.0:1788625556.007157:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788625556.011361:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.015535:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185256064 00000100:00100000:2.0:1788625556.015559:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185256064 00000100:00100000:2.0:1788625556.015638:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:2.0:1788625556.015649:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185256064:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788625556.015699:0:22799:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788625556.015832:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998744228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185256064:12345-192.168.204.14@tcp:53:lhsmtool_posix.0 Request processed in 184us (4712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.016708:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 59 00000100:00100000:3.0:1788625556.025093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.027487:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185256320 00000100:00100000:1.0:1788625556.027509:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185256320 00000100:00100000:1.0:1788625556.027656:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:1.0:1788625556.027671:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+39:18895:x1875509185256320:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.027701:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625556.027733:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c55d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7ec expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788625556.028274:0:24101:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1788625556.028283:0:24101:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788625556.028311:0:24101:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788625556.029515:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c564 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.029568:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c564 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.029583:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c564 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.029692:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c55d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ec expref: 42 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.029717:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c564 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ec expref: 41 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.029726:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998741f2b400) 00010000:00010000:1.0:1788625556.029729:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788625556.029734:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b41c00, rc 0) 00000100:00100000:1.0:1788625556.029836:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:18895:x1875509185256320:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 2167us (4768us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788625556.029847:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 60 00000100:00100000:3.0:1788625556.036859:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.038701:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185256576 00000100:00100000:1.0:1788625556.038724:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185256576 00000100:00100000:1.0:1788625556.038845:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:1.0:1788625556.038858:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:18895:x1875509185256576:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.038953:0:22800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625556.038993:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41c00/0x2d2e3b3f34a7c564 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ec expref: 41 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.039023:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998741f2b400) 00010000:00010000:1.0:1788625556.039039:0:22800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625556.039069:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.039087:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.039126:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045048:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045076:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045090:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045146:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045153:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045159:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045165:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.045169:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045177:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045190:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:1.0:1788625556.045193:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.045199:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045219:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41a00/0x2d2e3b3f34a7c572 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045237:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045242:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045248:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045252:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.045255:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045262:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045270:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd8d00eb3 (ffff998741f2bf00) 00010000:00010000:1.0:1788625556.045272:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.045275:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.045281:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c579 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd8d00eb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.047085:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+40:18895:x1875509185256576:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 8218us (10228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788625556.047097:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 61 00000100:00100000:0.0:1788625556.060805:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.060963:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185256704 00000100:00100000:2.0:1788625556.060977:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185256704 00000100:00100000:2.0:1788625556.061057:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:2.0:1788625556.061070:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+40:18895:x1875509185256704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625556.061110:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.061142:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c580 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7f3 expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061192:0:22801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c587 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061209:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c587 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061223:0:22801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c587 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061401:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c580 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7f3 expref: 42 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061427:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21a00/0x2d2e3b3f34a7c587 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7f3 expref: 41 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.061438:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:2.0:1788625556.061449:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625556.061454:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21a00, rc 0) 00000100:00100000:2.0:1788625556.061583:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99874422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:18895:x1875509185256704:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 514us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.061591:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 62 00000100:00100000:2.0:1788625556.071163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.071383:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185256960 00000100:00100000:1.0:1788625556.071410:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185256960 00000100:00100000:1.0:1788625556.071502:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:1.0:1788625556.071514:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+41:18895:x1875509185256960:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.071671:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.071699:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.071715:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788625556.071966:0:22799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1788625556.071980:0:22799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 677179461166ns, next at 678179457856ns, rc = 0 00000004:00010000:1.0:1788625556.072050:0:22799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050c38292 reply state 0000000087022577 transno 12884901918 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.072067:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.072076:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:1.0:1788625556.072087:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788625556.072092:0:22799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625556.072223:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+43:18895:x1875509185256960:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 709us (1073us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788625556.072231:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:3.0:1788625556.079446:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.079653:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257088 00000100:00100000:2.0:1788625556.079667:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257088 00000100:00100000:2.0:1788625556.079747:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:2.0:1788625556.079759:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+43:18895:x1875509185257088:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625556.079792:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.079820:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e7fa expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.079899:0:22801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 44 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.079917:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 44 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.079939:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:2.0:1788625556.079943:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788625556.079948:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da21000, rc 0) 00000100:00100000:2.0:1788625556.080148:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+44:18895:x1875509185257088:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 390us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.080157:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:0.0:1788625556.088798:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.089291:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257216 00000100:00100000:2.0:1788625556.089324:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257216 00000100:00100000:2.0:1788625556.089480:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:2.0:1788625556.089494:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2393:x1875509185257216:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788625556.089866:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2393:x1875509185257216:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 375us (1084us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788625556.089874:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00080000:0.0:1788625556.091044:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788625556.093036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.093166:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257472 00000100:00100000:1.0:1788625556.093179:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257472 00000100:00100000:1.0:1788625556.093258:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:1.0:1788625556.093269:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+44:18895:x1875509185257472:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788625556.093667:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+45:18895:x1875509185257472:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 399us (659us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788625556.093676:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 11 00000100:00100000:1.0:1788625556.096672:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.096784:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257728 00000100:00100000:2.0:1788625556.096798:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257728 00000100:00100000:2.0:1788625556.096874:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:2.0:1788625556.096886:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+45:18895:x1875509185257728:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788625556.097063:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+45:18895:x1875509185257728:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 178us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.097071:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:2.0:1788625556.099728:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.099853:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257856 00000100:00100000:1.0:1788625556.099866:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257856 00000100:00100000:1.0:1788625556.099971:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625556.099984:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+45:18895:x1875509185257856:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.100013:0:24101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788625556.100042:0:24101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c59c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e801 expref: -99 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100236:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100253:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100266:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788625556.100319:0:24101:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788625556.100341:0:24101:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100369:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c59c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e801 expref: 47 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100398:0:24101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e801 expref: 46 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.100415:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:1.0:1788625556.100417:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788625556.100422:0:24101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998743b40600, rc 0) 00000100:00100000:1.0:1788625556.100512:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+46:18895:x1875509185257856:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 530us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.100568:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625556.103767:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.103891:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185257984 00000100:00100000:2.0:1788625556.103980:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185257984 00000100:00100000:2.0:1788625556.104155:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:2.0:1788625556.104168:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+6:2394:x1875509185257984:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625556.104189:0:24306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.104213:0:24306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e808 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788625556.104241:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c4293, blocks: 0x0 00010000:00010000:2.0:1788625556.104263:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=677s v=(0 0) 00010000:00010000:2.0:1788625556.104268:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625556.104278:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 7 pid: 24306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.104320:0:24306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 7 pid: 24306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.104334:0:24306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887da20800, rc 0) 00000100:00100000:2.0:1788625556.104422:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2394:x1875509185257984:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 257us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.104429:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:3.0:1788625556.112300:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.113500:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185258240 00000100:00100000:1.0:1788625556.113568:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185258240 00000100:00100000:1.0:1788625556.113659:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:1.0:1788625556.113669:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+46:18895:x1875509185258240:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788625556.113783:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+46:18895:x1875509185258240:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 114us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.113792:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 67 00000100:00100000:0.0:1788625556.121078:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.121182:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185258368 00000100:00100000:2.0:1788625556.121191:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185258368 00000100:00100000:2.0:1788625556.121290:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:2.0:1788625556.121301:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+46:18895:x1875509185258368:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788625556.123608:0:22779:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901919 is committed 00000004:00080000:2.0:1788625556.123637:0:22779:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788625556.123709:0:22779:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788625556.123813:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206322176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788625556.123882:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625556.123927:0:25380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206322176 00000100:00100000:0.0:1788625556.123934:0:25380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206322176 00000100:00100000:2.0:1788625556.123968:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18895:x1875509185258368:12345-192.168.204.14@tcp:44:lhsmtool_posix.0 Request processed in 2667us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.123977:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 68 00000100:00100000:0.0:1788625556.123986:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625556.123994:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206322176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788625556.124122:0:25380:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788625556.124126:0:25380:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788625556.124129:0:25380:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788625556.124131:0:25380:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788625555 -> 1788625555 00002000:00010000:0.0:1788625556.124134:0:25380:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788625556.124179:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1875509206322176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (295us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788625556.124186:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788625556.124194:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788625556.124201:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788625556.124205:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.124213:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.124219:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.124271:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.124297:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.124313:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:1.0:1788625556.124316:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788625556.124321:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.124327:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b683a00/0x2d2e3b3f34a7c3c0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788625556.124420:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9988449adc00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788625556.124426:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206322176:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788625556.125123:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125141:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125147:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125152:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.125155:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125161:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125172:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9988749c3f00) 00010000:00010000:2.0:1788625556.125175:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.125178:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125184:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668000/0x2d2e3b3f34a7c36c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125202:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125207:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125211:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125216:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.125224:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125229:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125236:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:2.0:1788625556.125239:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.125241:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125246:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c373 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125257:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125262:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125267:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125271:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.125274:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125279:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125285:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99885129c300) 00010000:00010000:2.0:1788625556.125288:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.125297:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125303:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682400/0x2d2e3b3f34a7c41b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125893:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125901:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125907:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125912:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b682600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.125916:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125922:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125932:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625556.125934:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.125937:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125942:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887b682600/0x2d2e3b3f34a7c4a0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125952:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125969:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125975:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125981:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.125984:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125989:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.125996:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625556.125998:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.126001:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126007:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c4c3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126018:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126024:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126029:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126033:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b41600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.126042:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126048:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126056:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625556.126058:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788625556.126061:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126067:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41600/0x2d2e3b3f34a7c509 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126078:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126084:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126090:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126096:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1788625556.126098:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126104:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126110:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:2.0:1788625556.126112:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788625556.126299:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.126305:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40400/0x2d2e3b3f34a7c58e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625556.127382:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625556.127490:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185258496 00000100:00100000:3.0:1788625556.127499:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185258496 00000100:00100000:3.0:1788625556.127571:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:3.0:1788625556.127616:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2393:x1875509185258496:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788625556.127730:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2393:x1875509185258496:12345-192.168.204.14@tcp:16:lhsmtool_posix.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.129969:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:2.0:1788625556.133057:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.135020:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185258752 00000100:00100000:1.0:1788625556.135033:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185258752 00000100:00100000:1.0:1788625556.135103:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:1.0:1788625556.135114:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+14:18895:x1875509185258752:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.135173:0:22800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625556.135201:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e801 expref: 14 pid: 24101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.135221:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:1.0:1788625556.135226:0:22800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788625556.135259:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c5b1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.135274:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c5b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.135285:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c5b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625556.135583:0:22800:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036e24624 reply state 000000000d04236f transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c5b1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.135596:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b41400/0x2d2e3b3f34a7c5b1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.135610:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:1.0:1788625556.135613:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788625556.135615:0:22800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788625556.135720:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998844935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:18895:x1875509185258752:12345-192.168.204.14@tcp:36:lhsmtool_posix.0 Request processed in 607us (2672us total) trans 12884901920 rc 0/0 00000100:00100000:1.0:1788625556.135727:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 69 00000100:00100000:0.0:1788625556.144196:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.144320:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185258880 00000100:00100000:2.0:1788625556.144332:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185258880 00000100:00100000:2.0:1788625556.144446:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:2.0:1788625556.144457:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988668bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18895:x1875509185258880:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788625556.144475:0:24306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.144495:0:24306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e80f expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.144564:0:24306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.144574:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625556.144578:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788625556.144583:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.144620:0:24306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.144635:0:24306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 777 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625556.144669:0:24306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24306:1875509206322304:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625556.144805:0:24306:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625556.148071:0:24306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24306:1875509206322304:192.168.204.14@tcp:104: 00010000:00010000:3.0:1788625556.148111:0:24306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.148131:0:24306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5c00, rc 0) 00000100:00100000:3.0:1788625556.148193:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988668bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:18895:x1875509185258880:12345-192.168.204.14@tcp:101:lhsmtool_posix.0 Request processed in 3738us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.148217:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:3.0:1788625556.150706:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625556.150834:0:22784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259008 00000100:00100000:0.0:1788625556.150843:0:22784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259008 00010000:00010000:0.0:1788625556.150881:0:22784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 777 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625556.150920:0:22784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:0.0:1788625556.150930:0:22784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2394:x1875509185259008:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788625556.150945:0:22784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788625556.150968:0:22784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 777 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.151000:0:22784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 777 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.151023:0:22784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091df3336/0x2d2e3b3f34a7c5aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e808 expref: 8 pid: 24306 timeout: 777 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.151039:0:22784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625556.151044:0:22784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788625556.151050:0:22784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 7 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.151061:0:22784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 7 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.151171:0:22784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 7 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625556.151187:0:22784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22784:1875509206322432:192.168.204.14@tcp:105: 00000100:00100000:0.0:1788625556.151315:0:22784:0:(client.c:2716:ptlrpc_set_wait()) set ffff998742dd7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788625556.153185:0:22784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22784:1875509206322432:192.168.204.14@tcp:105: 00010000:00010000:3.0:1788625556.153208:0:22784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625556.153315:0:22784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2394:x1875509185259008:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 2386us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.153326:0:22784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:2.0:1788625556.154204:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625556.154285:0:25380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259136 00000100:00100000:0.0:1788625556.154779:0:25380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259136 00000100:00100000:0.0:1788625556.154830:0:25380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:0.0:1788625556.154840:0:25380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2394:x1875509185259136:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788625556.154976:0:25380:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788625556.154991:0:25380:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788625554 00002000:00010000:0.0:1788625556.154994:0:25380:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788625551 00002000:00010000:0.0:1788625556.154997:0:25380:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788625555 -> 1788625554 00002000:00010000:0.0:1788625556.154999:0:25380:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788625556.155072:0:25380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2394:x1875509185259136:12345-192.168.204.14@tcp:2:lhsmtool_posix.0 Request processed in 232us (868us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788625556.155143:0:25380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 25 00000100:00100000:2.0:1788625556.157191:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625556.157249:0:24305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259264 00000100:00100000:3.0:1788625556.157258:0:24305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259264 00000100:00100000:3.0:1788625556.157363:0:24305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:3.0:1788625556.157375:0:24305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2394:x1875509185259264:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788625556.157439:0:24305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.157461:0:24305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.157471:0:24305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625556.157475:0:24305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625556.157480:0:24305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.157559:0:24305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.157596:0:24305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 8 pid: 24306 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.157611:0:24305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24305:1875509206322560:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625556.158253:0:24305:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988512cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788625556.161176:0:24305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24305:1875509206322560:192.168.204.14@tcp:104: 00010000:00010000:0.0:1788625556.161208:0:24305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625556.162692:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:3.0:1788625556.162794:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259392 00000100:00100000:3.0:1788625556.162803:0:22786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259392 00010000:00010000:3.0:1788625556.162854:0:22786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 9 pid: 24306 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.162997:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:3.0:1788625556.163008:0:22786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+9:2394:x1875509185259392:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625556.163038:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625556.163060:0:22786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 9 pid: 24306 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.163075:0:22786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 9 pid: 24306 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.163098:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d25a1720/0x2d2e3b3f34a7c5b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e80f expref: 9 pid: 24306 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.163116:0:22786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625556.163120:0:22786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788625556.163138:0:22786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.163149:0:22786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.163186:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625556.163253:0:22786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2394:x1875509185259392:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 246us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.163262:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00010000:00010000:0.0:1788625556.163331:0:24305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163342:0:24305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163362:0:24305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163371:0:24305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163379:0:24305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163418:0:24305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99887b683c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:0.0:1788625556.163422:0:24305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163431:0:24305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163443:0:24305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788625556.163452:0:24305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd1a27fb/0x2d2e3b3f34a7c5bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788625556.163498:0:24305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:2394:x1875509185259264:12345-192.168.204.14@tcp:1:lhsmtool_posix.0 Request processed in 6126us (6313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625556.163505:0:24305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 26 00000100:00100000:2.0:1788625556.166454:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.166589:0:24101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259648 00000100:00100000:1.0:1788625556.166598:0:24101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259648 00000100:00100000:1.0:1788625556.166684:0:24101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 70 00000100:00100000:1.0:1788625556.166696:0:24101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:18895:x1875509185259648:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788625556.166792:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.166811:0:24101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 15 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.166821:0:24101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.166858:0:24101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 15 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.166891:0:24101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 15 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.166907:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206322688:192.168.204.14@tcp:104: 00000100:00100000:1.0:1788625556.166999:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788625556.169102:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206322688:192.168.204.14@tcp:104: 00010000:00010000:2.0:1788625556.169143:0:24101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625556.169961:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.170042:0:23551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259776 00000100:00100000:1.0:1788625556.170050:0:23551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259776 00010000:00010000:1.0:1788625556.170106:0:23551:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.170181:0:23551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 23 00000100:00100000:1.0:1788625556.170191:0:23551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998866ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+16:2394:x1875509185259776:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788625556.170205:0:23551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788625556.170212:0:23551:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170226:0:23551:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170248:0:23551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4200/0x2d2e3b3f34a7c499 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7ad expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170263:0:23551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.170269:0:23551:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 15 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170296:0:23551:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170305:0:23551:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170312:0:23551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.170344:0:23551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788625556.170411:0:23551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998866ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:2394:x1875509185259776:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 220us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.170419:0:23551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 23 00010000:00010000:2.0:1788625556.170551:0:24101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170560:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170758:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170771:0:24101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 15 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170779:0:24101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170818:0:24101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 15 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.170832:0:24101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 15 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788625556.170845:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206322816:192.168.204.14@tcp:104: 00000100:00100000:2.0:1788625556.170901:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9987438c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788625556.173725:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.173745:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743831500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206322816:192.168.204.14@tcp:104: 00010000:00010000:1.0:1788625556.173776:0:24101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.173791:0:22785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185259904 00000100:00100000:3.0:1788625556.173800:0:22785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185259904 00010000:00010000:3.0:1788625556.173893:0:22785:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.173920:0:22785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 24 00000100:00100000:3.0:1788625556.173996:0:22785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+16:2394:x1875509185259904:12345-192.168.204.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788625556.174010:0:22785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788625556.174017:0:22785:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174029:0:22785:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174050:0:22785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99887da21000/0x2d2e3b3f34a7c595 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7fa expref: 16 pid: 22801 timeout: 777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174064:0:22785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:3.0:1788625556.174091:0:22785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174098:0:22785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174103:0:22785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.174122:0:22785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788625556.174160:0:22785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+15:2394:x1875509185259904:12345-192.168.204.14@tcp:103:ldlm_bl.0 Request processed in 171us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.174165:0:22785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 24 00010000:00010000:1.0:1788625556.174187:0:24101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.174197:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788625556.174401:0:24101:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1788625556.174550:0:24101:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000001:00080000:1.0:1788625556.174590:0:24101:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788625556.174665:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24101:1875509206322944:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788625556.174721:0:24101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625556.174769:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff998850dbd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788625556.174781:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206322944 00000100:00100000:3.0:1788625556.174786:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206322944 00000100:00100000:3.0:1788625556.174825:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788625556.174833:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24101:x1875509206322944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788625556.174937:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:24101:x1875509206322944:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625556.174944:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788625556.175067:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24101:1875509206322944:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788625556.175216:0:24101:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000100:00100000:1.0:1788625556.175258:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24101:1875509206323072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788625556.175290:0:24101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625556.175324:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988582e06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788625556.175377:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323072 00000100:00100000:0.0:1788625556.175382:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323072 00000100:00100000:0.0:1788625556.175425:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788625556.175434:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:24101:x1875509206323072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788625556.175585:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:24101:x1875509206323072:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (293us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788625556.175592:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788625556.175789:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d63800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24101:1875509206323072:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788625556.175821:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175830:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175923:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175931:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e4600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.175935:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175945:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175959:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:1.0:1788625556.175961:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625556.175965:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.175971:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e4600/0x2d2e3b3f34a7c5cd lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176016:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176023:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176029:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176034:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998742668400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.176038:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176044:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176052:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.176054:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788625556.176061:0:24101:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 18 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176072:0:24101:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 18 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176081:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 18 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.176198:0:24101:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40a00/0x2d2e3b3f34a7c52c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e7de expref: 18 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.176224:0:24101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206323200:192.168.204.14@tcp:105: 00000100:00100000:1.0:1788625556.176286:0:24101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9988781a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788625556.179253:0:24101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24101:1875509206323200:192.168.204.14@tcp:105: 00010000:00010000:1.0:1788625556.179290:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179301:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998742668400/0x2d2e3b3f34a7c525 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179334:0:24101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179347:0:24101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179358:0:24101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179369:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179376:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179382:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179398:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.179403:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179423:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179435:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.179438:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.179442:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179448:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c5d4 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179458:0:24101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179465:0:24101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179470:0:24101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179475:0:24101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.179478:0:24101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179484:0:24101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179491:0:24101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.179494:0:24101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788625556.179497:0:24101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.179512:0:24101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c5c6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24101 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.179720:0:24101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18895:x1875509185259648:12345-192.168.204.14@tcp:57:lhsmtool_posix.0 Request processed in 13025us (13341us total) trans 12884901925 rc 0/0 00000100:00100000:1.0:1788625556.179731:0:24101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 70 00000020:00080000:1.0:1788625556.179738:0:24101:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788625556.179894:0:22832:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788625556.179899:0:22832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788625556.179918:0:22832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788625556.179924:0:22832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788625556.180888:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.180962:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185260032 00000100:00100000:1.0:1788625556.180968:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185260032 00000100:00100000:1.0:1788625556.181077:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:1.0:1788625556.181086:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18894:x1875509185260032:12345-192.168.204.14@tcp:49:bash.0 00000100:00100000:1.0:1788625556.181207:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18894:x1875509185260032:12345-192.168.204.14@tcp:49:bash.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.181214:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 12 00000100:00100000:0.0:1788625556.184416:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625556.184484:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.184488:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185260416 00000100:00100000:2.0:1788625556.184503:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185260416 00000100:00100000:2.0:1788625556.184603:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 13 00000100:00100000:2.0:1788625556.184613:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+18:18895:x1875509185260416:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788625556.184742:0:24306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185260160 00000100:00100000:3.0:1788625556.184747:0:24306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185260160 00000100:00100000:3.0:1788625556.184784:0:24306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 27 00000100:00100000:3.0:1788625556.184790:0:24306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+7:18894:x1875509185260160:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:3.0:1788625556.184800:0:24306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788625556.184831:0:24306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e567e3/0x2d2e3b3f34a7c5db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e816 expref: -99 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788625556.184862:0:24306:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9c4292, atime: 0x6a9c428f, ctime: 0x6a9c4292, blocks: 0x0 00010000:00010000:3.0:1788625556.184887:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=677s v=(0 0) 00000004:00080000:2.0:1788625556.184898:0:22803:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1788625556.184901:0:24306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788625556.184910:0:24306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e567e3/0x2d2e3b3f34a7c5db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e816 expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.184927:0:24306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e567e3/0x2d2e3b3f34a7c5db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e816 expref: 8 pid: 24306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788625556.184928:0:22803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00010000:00010000:3.0:1788625556.184940:0:24306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99887b682600, rc 0) 00010000:00010000:2.0:1788625556.184955:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.184967:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.184976:0:22803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.184995:0:22803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.184999:0:24306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:18894:x1875509185260160:12345-192.168.204.14@tcp:101:bash.0 Request processed in 208us (514us total) trans 0 rc 0/0 00010000:00010000:2.0:1788625556.185003:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788625556.185006:0:24306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 27 00010000:00010000:2.0:1788625556.185806:0:22803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.185959:0:22803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788625556.186039:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18895:x1875509185260416:12345-192.168.204.14@tcp:35:lhsmtool_posix.0 Request processed in 1427us (1631us total) trans 12884901927 rc 0/0 00000100:00100000:2.0:1788625556.186049:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 13 00000020:00080000:2.0:1788625556.186053:0:22803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788625556.186124:0:22787:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788625556.186138:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.186145:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9988412e5c00 already unused, calling callback (ffffffffc0dba4f0) 00010000:00010000:3.0:1788625556.186149:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.186158:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.186177:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff998743548600) 00010000:00010000:3.0:1788625556.186180:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788625556.186184:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.186190:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5c00/0x2d2e3b3f34a7c5e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788625556.186213:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625556.186215:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788625556.186216:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625556.188471:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.188567:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185260544 00000100:00100000:2.0:1788625556.188576:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185260544 00000100:00100000:2.0:1788625556.188626:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:2.0:1788625556.188636:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+20:18894:x1875509185260544:12345-192.168.204.14@tcp:101:bash.0 00010000:00010000:2.0:1788625556.188661:0:22799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.188681:0:22799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c5e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e81d expref: -99 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.188713:0:22799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c5f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.188727:0:22799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c5f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.188737:0:22799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c5f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.188987:0:22799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c5e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e81d expref: 22 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.189000:0:22799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5800/0x2d2e3b3f34a7c5f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e81d expref: 21 pid: 22799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.189006:0:22799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:2.0:1788625556.189061:0:22799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788625556.189065:0:22799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5800, rc 0) 00000100:00100000:2.0:1788625556.189119:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:18894:x1875509185260544:12345-192.168.204.14@tcp:101:bash.0 Request processed in 484us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625556.189127:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 71 00000100:00100000:0.0:1788625556.192435:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.192869:0:22802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185260800 00000100:00100000:1.0:1788625556.193273:0:22802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185260800 00000100:00100000:1.0:1788625556.193617:0:22802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 14 00000100:00100000:1.0:1788625556.193716:0:22802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+21:18894:x1875509185260800:12345-192.168.204.14@tcp:35:bash.0 00000001:00080000:1.0:1788625556.194507:0:22802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000001:00080000:1.0:1788625556.194832:0:22802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901929 00000100:00100000:1.0:1788625556.195285:0:22802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+24:18894:x1875509185260800:12345-192.168.204.14@tcp:35:bash.0 Request processed in 1571us (2858us total) trans 12884901930 rc 0/0 00000100:00100000:1.0:1788625556.195295:0:22802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 14 00000020:00080000:1.0:1788625556.195300:0:22802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788625556.275928:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.282741:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261056 00000100:00100000:2.0:1788625556.282755:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261056 00000100:00100000:2.0:1788625556.282885:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:2.0:1788625556.282897:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+24:18905:x1875509185261056:12345-192.168.204.14@tcp:101:lfs.0 00010000:00010000:2.0:1788625556.282936:0:22801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788625556.282958:0:22801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c5f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33c08e5e1fe3e824 expref: -99 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788625556.283055:0:22801:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788625556.283171:0:22801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c5f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e824 expref: 26 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.283185:0:22801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998743548f00) 00010000:00010000:2.0:1788625556.283188:0:22801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788625556.283208:0:22801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9988412e5e00/0x2d2e3b3f34a7c5f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.14@tcp remote: 0x33c08e5e1fe3e824 expref: 26 pid: 22801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788625556.283222:0:22801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9988412e5e00, rc 0) 00000100:00100000:2.0:1788625556.283286:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:18905:x1875509185261056:12345-192.168.204.14@tcp:101:lfs.0 Request processed in 392us (7367us total) trans 12884901931 rc 301/301 00000100:00100000:2.0:1788625556.283293:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 72 00000100:00100000:0.0:1788625556.293333:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:1.0:1788625556.293453:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261184 00000100:00100000:1.0:1788625556.293477:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261184 00000100:00100000:1.0:1788625556.293575:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:1.0:1788625556.293586:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:18905:x1875509185261184:12345-192.168.204.14@tcp:34:lfs.0 00010000:00010000:1.0:1788625556.293683:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293702:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293714:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293730:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293737:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293744:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293832:0:22800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293852:0:22800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293860:0:22800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788625556.293908:0:22800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293935:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293942:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293949:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293955:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.293959:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293967:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293978:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff998743548b00) 00010000:00010000:1.0:1788625556.293982:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.293986:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.293993:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40200/0x2d2e3b3f34a7c605 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294007:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294012:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294019:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294032:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.294036:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294042:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294051:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff998741f2bf00) 00010000:00010000:1.0:1788625556.294054:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.294057:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294063:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40600/0x2d2e3b3f34a7c60c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294079:0:22800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294085:0:22800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294090:0:22800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294095:0:22800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998743b40e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1788625556.294097:0:22800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294103:0:22800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294120:0:22800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99885129c400) 00010000:00010000:1.0:1788625556.294122:0:22800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788625556.294125:0:22800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788625556.294131:0:22800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998743b40e00/0x2d2e3b3f34a7c613 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788625556.294354:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:18905:x1875509185261184:12345-192.168.204.14@tcp:34:lfs.0 Request processed in 769us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625556.294363:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 73 00000100:00100000:0.0:1788625556.297500:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625556.298192:0:22803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261440 00000100:00100000:2.0:1788625556.298203:0:22803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261440 00000100:00100000:2.0:1788625556.298267:0:22803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 15 00000100:00100000:2.0:1788625556.298279:0:22803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+25:18905:x1875509185261440:12345-192.168.204.14@tcp:35:lfs.0 00000100:00100000:2.0:1788625556.298570:0:22803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca0f9b0c-1e13-4da9-865b-75626250b5f8+26:18905:x1875509185261440:12345-192.168.204.14@tcp:35:lfs.0 Request processed in 292us (1077us total) trans 12884901932 rc 0/0 00000100:00100000:2.0:1788625556.298580:0:22803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 15 00010000:00010000:2.0:1788625556.555793:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788625557.259767:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788625557.259793:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206323328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788625557.259867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.260055:0:24309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323328 00000100:00100000:2.0:1788625557.260064:0:24309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323328 00000100:00100000:2.0:1788625557.260120:0:24309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625557.260130:0:24309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206323328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788625557.260159:0:24309:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788625557.260204:0:24309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875509206323328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625557.260210:0:24309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788625557.260256:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875509206323328:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788625557.262197:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625557.262648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206323584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788625557.262717:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.262777:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788625557.262785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206323712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788625557.262809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.262848:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625557.262858:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206323456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788625557.262895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.262928:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323584 00000100:00100000:2.0:1788625557.262937:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323584 00000100:00100000:2.0:1788625557.262983:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323712 00000100:00100000:2.0:1788625557.262986:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323712 00000100:00100000:2.0:1788625557.263011:0:25591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323456 00000100:00100000:2.0:1788625557.263014:0:25591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323456 00000100:00100000:1.0:1788625557.263309:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625557.263323:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206323584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788625557.263435:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625557.263509:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875509206323584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.263540:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788625557.263564:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788625557.263571:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206323712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788625557.263584:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788625557.263614:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875509206323712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.263620:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788625557.263631:0:24308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788625557.263638:0:24308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99884435b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206323456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788625557.263647:0:24308:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788625557.263686:0:24308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99884435b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206323456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.263693:0:24308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788625557.263993:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206323712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788625557.264009:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875509206323584:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788625557.264120:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788625557.264125:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788625557.264149:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206323456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788625557.264486:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206323840:0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.264551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625557.264587:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788625557.264596:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206323968:0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.264631:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.264650:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.264657:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206324352:0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.264692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625557.264698:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.264724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206324736:0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.264737:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206324864:0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.264757:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788625557.264776:0:22793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323840 00000100:00100000:0.0:1788625557.264782:0:22793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323840 00000100:00100000:0.0:1788625557.264833:0:22793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788625557.264843:0:22793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3635:x1875509206323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.264886:0:22793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:808ac1e0-6c01-40fe-b8c2-33bc603cb30f+24:3635:x1875509206323840:12345-0@lo:400:kworker.0 Request processed in 46us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625557.264904:0:22793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788625557.264933:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206323968 00000100:00100000:0.0:1788625557.264937:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206323968 00000100:00100000:0.0:1788625557.264965:0:22805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324224 00000100:00100000:0.0:1788625557.264967:0:22805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324224 00000100:00100000:0.0:1788625557.264981:0:22805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788625557.264987:0:22805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206323968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.265020:0:22805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875509206323968:12345-0@lo:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625557.265463:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788625557.265474:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206324096:0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.265580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625557.265589:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206324480:0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.265604:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206324608:0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.265624:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324352 00000100:00100000:1.0:1788625557.265630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788625557.265631:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324352 00000100:00100000:2.0:1788625557.265653:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324736 00000100:00100000:2.0:1788625557.265658:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324736 00000100:00100000:3.0:1788625557.265661:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324096 00000100:00100000:3.0:1788625557.265666:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324096 00000100:00100000:3.0:1788625557.265678:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324480 00000100:00100000:3.0:1788625557.265681:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324480 00000100:00100000:2.0:1788625557.265696:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788625557.265704:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206324352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.265720:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788625557.265730:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206324096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.265758:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875509206324352:12345-0@lo:400:kworker.0 Request processed in 54us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.265760:0:24101:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788625557.265770:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788625557.265772:0:24101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788625557.265782:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875509206324096:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625557.265790:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788625557.265796:0:22800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788625557.265807:0:22800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206324736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.265810:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788625557.265818:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206324480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.265854:0:22799:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788625557.265860:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875509206324480:12345-0@lo:400:kworker.0 Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.265869:0:22800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875509206324736:12345-0@lo:400:kworker.0 Request processed in 64us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625557.265870:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788625557.265874:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788625557.265893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625557.265893:0:22800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788625557.265915:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875509206324480:0@lo:400:kworker.0 00000100:00100000:1.0:1788625557.265916:0:22800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324608 00000100:00100000:1.0:1788625557.265922:0:22800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324608 00000100:00100000:2.0:1788625557.265930:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875509206324736:0@lo:400:kworker.0 00000100:00100000:2.0:1788625557.265954:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875509206324096:0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.265961:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625557.265970:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206324608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788625557.265970:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788625557.266005:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875509206324608:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00010000:00080000:2.0:1788625557.266073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743b31880 x1875509206324608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788625557.266083:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875509206324608:0@lo:400:kworker.0 00000100:00100000:0.0:1788625557.266318:0:22805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788625557.266393:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788625557.266478:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625557.266494:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206324224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.266607:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875509206324224:12345-0@lo:400:kworker.0 Request processed in 114us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788625557.266638:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788625557.266663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.266669:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875509206324224:0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.266707:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99884435a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875509206323968:0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.266720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:808ac1e0-6c01-40fe-b8c2-33bc603cb30f:3635:1875509206323840:0@lo:400:kworker.0 00000100:00100000:3.0:1788625557.266741:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998844359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875509206324352:0@lo:400:kworker.0 00000100:00100000:1.0:1788625557.266795:0:22801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324864 00000100:00100000:1.0:1788625557.266800:0:22801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324864 00000100:00100000:1.0:1788625557.266957:0:22801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788625557.267238:0:22801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206324864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788625557.267291:0:22801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998872d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875509206324864:12345-0@lo:400:kworker.0 Request processed in 327us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.267297:0:22801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788625557.267633:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998743b31c00 x1875509206324864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788625573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788625557.267646:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998743b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875509206324864:0@lo:400:kworker.0 00000100:00080000:2.0:1788625557.267772:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788625557.579768:0:22788:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788625557.681850:0:25881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1788625557.771811:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788625557.771836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff998872d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788625557.771920:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788625557.772079:0:23824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206324992 00000100:00100000:1.0:1788625557.772095:0:23824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206324992 00000100:00100000:1.0:1788625557.772160:0:23824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788625557.772170:0:23824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206324992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788625557.772206:0:23824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788625557.772272:0:23824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875509206324992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625557.772298:0:23824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788625557.772499:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788625557.772511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206325120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788625557.772691:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788625557.772752:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff998872d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875509206324992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788625557.772939:0:22804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509206325120 00000100:00100000:0.0:1788625557.772945:0:22804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509206325120 00000100:00100000:0.0:1788625557.772982:0:22804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788625557.772989:0:22804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206325120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788625557.773010:0:22804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788625557.773045:0:22804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998743b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875509206325120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625557.773055:0:22804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788625557.773128:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9988449aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875509206325120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788625558.603797:0:22787:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788625558.668415:0:23553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788625559.045892:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.045944:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.045986:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046007:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046048:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046081:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046102:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046145:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.046178:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262080 00000100:00100000:0.0:1788625559.046186:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262080 00000100:00100000:2.0:1788625559.046188:0:22794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261568 00000100:00100000:2.0:1788625559.046195:0:22794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261568 00000100:00100000:0.0:1788625559.046242:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262592 00000100:00100000:0.0:1788625559.046246:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262592 00000100:00100000:2.0:1788625559.046261:0:22794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00100000:0.0:1788625559.046267:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261952 00000100:00100000:0.0:1788625559.046271:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261952 00000100:00100000:2.0:1788625559.046277:0:22794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2392:x1875509185261568:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:0.0:1788625559.046288:0:24307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262464 00000100:00100000:0.0:1788625559.046292:0:24307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262464 00000100:00100000:0.0:1788625559.046310:0:24307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:0.0:1788625559.046318:0:24307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2392:x1875509185262080:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:2.0:1788625559.046372:0:22794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99886d7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:532c19fa-8f42-4ef8-bbda-4aa0713b1686+13:2392:x1875509185261568:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 101us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625559.046380:0:22794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 164 00000100:00080000:2.0:1788625559.046411:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788625559.046415:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788625559.046568:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261824 00000100:00100000:1.0:1788625559.046573:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261824 00000100:00100000:1.0:1788625559.046609:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262336 00000100:00100000:1.0:1788625559.046613:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262336 00000100:00100000:1.0:1788625559.046627:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185261696 00000100:00100000:1.0:1788625559.046630:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185261696 00000100:00100000:1.0:1788625559.046642:0:22799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262208 00000100:00100000:1.0:1788625559.046644:0:22799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262208 00000100:00100000:1.0:1788625559.046657:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:1.0:1788625559.046664:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185261824:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046695:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185261824:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 31us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046701:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 63 00000100:00100000:1.0:1788625559.046714:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:1.0:1788625559.046720:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262336:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046740:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262336:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 20us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046745:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 64 00000100:00100000:1.0:1788625559.046756:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:1.0:1788625559.046762:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+26:2392:x1875509185261696:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046786:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+26:2392:x1875509185261696:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046791:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 65 00000100:00100000:1.0:1788625559.046801:0:22799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625559.046816:0:22799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2392:x1875509185262208:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046841:0:22799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e10baa21-d455-4ab1-8b08-cff99c0f467e+6:2392:x1875509185262208:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046846:0:22799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 66 00000100:00100000:1.0:1788625559.046867:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625559.046873:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262592:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046896:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262592:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 24us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046903:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 20 00000100:00100000:1.0:1788625559.046916:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625559.046922:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185261952:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046943:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987442d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+5:2392:x1875509185261952:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 22us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046949:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 21 00000100:00100000:1.0:1788625559.046958:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00100000:1.0:1788625559.046965:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262464:12345-192.168.204.14@tcp:400:kworker.0 00000100:00100000:1.0:1788625559.046985:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e10baa21-d455-4ab1-8b08-cff99c0f467e+5:2392:x1875509185262464:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 21us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788625559.046992:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 22 00000100:00080000:2.0:1788625559.047294:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788625559.047299:0:22795:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788625559.048601:0:24307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9988449aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2392:x1875509185262080:12345-192.168.204.14@tcp:400:kworker.0 Request processed in 2277us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788625559.048613:0:24307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 19 00000100:00100000:0.0:1788625559.553629:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:0.0:1788625559.553735:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.14@tcp (source: 12345-192.168.204.14@tcp) 00000100:00100000:2.0:1788625559.553864:0:25084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262848 00000100:00100000:2.0:1788625559.553874:0:25084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262848 00000100:00100000:2.0:1788625559.553937:0:25084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:2.0:1788625559.553948:0:25084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2392:x1875509185262848:12345-192.168.204.14@tcp:16:kworker.0 00000100:00100000:2.0:1788625559.554067:0:25084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2392:x1875509185262848:12345-192.168.204.14@tcp:16:kworker.0 Request processed in 121us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788625559.554075:0:25084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 28 00000100:00100000:2.0:1788625559.554207:0:24310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875509185262720 00000100:00100000:2.0:1788625559.554211:0:24310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875509185262720 00002000:00100000:2.0:1788625559.554234:0:24310:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9987439f7480 x1875509185262720/t0(0) o4->ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp:370/0 lens 504/0 e 0 to 0 dl 1788625570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788625559.554245:0:24310:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439f7480 with x1875509185262720 ext(0->8) 00002000:00010000:2.0:1788625559.554252:0:24310:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439f7480 00000100:00100000:2.0:1788625559.554268:0:24310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.14@tcp, seq: 0 00000100:00100000:2.0:1788625559.554275:0:24310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9987439f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+8:2392:x1875509185262720:12345-192.168.204.14@tcp:4:bash.0 00000100:00100000:0.0:1788625559.557865:0:24310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9987439f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca0f9b0c-1e13-4da9-865b-75626250b5f8+10:2392:x1875509185262720:12345-192.168.204.14@tcp:4:bash.0 Request processed in 3579us (4118us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788625559.557884:0:24310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.14@tcp, seq: 0 00002000:00100000:0.0:1788625559.557898:0:24310:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9987439f7480 x1875509185262720/t12884901895(0) o4->ca0f9b0c-1e13-4da9-865b-75626250b5f8@192.168.204.14@tcp:370/0 lens 504/448 e 0 to 0 dl 1788625570 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788625559.557908:0:24310:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9987439f7480 with x1875509185262720 ext(0->8) 00002000:00010000:0.0:1788625559.557915:0:24310:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9987439f7480 00010000:00010000:3.0:1788625559.638421:0:25134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14230 lines, 14230 kept, 0 dropped, 0 bad.